-- Logs begin at Fri 2021-01-15 01:53:04 UTC, end at Fri 2021-01-15 03:00:55 UTC. -- Jan 15 02:29:37.174648 dv-cinder-763306-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 15 02:29:37.182872 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 15 02:29:37.184837 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: *** Starting uWSGI 2.0.15-debian (64bit) on [Fri Jan 15 02:29:37 2021] *** Jan 15 02:29:37.184837 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Jan 15 02:29:37.184837 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Jan 15 02:29:37.184837 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: nodename: dv-cinder-763306-8-iscsi Jan 15 02:29:37.184837 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: machine: x86_64 Jan 15 02:29:37.184837 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: clock source: unix Jan 15 02:29:37.184837 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: pcre jit disabled Jan 15 02:29:37.184837 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: detected number of CPU cores: 4 Jan 15 02:29:37.184837 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: current working directory: / Jan 15 02:29:37.184837 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: detected binary path: /usr/bin/uwsgi-core Jan 15 02:29:37.184837 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: dropping root privileges as early as possible Jan 15 02:29:37.184837 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: your processes number limit is 47843 Jan 15 02:29:37.185854 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: your memory page size is 4096 bytes Jan 15 02:29:37.185854 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: detected max file descriptor number: 2048 Jan 15 02:29:37.185854 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: lock engine: pthread robust mutexes Jan 15 02:29:37.185854 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: thunder lock: enabled Jan 15 02:29:37.185854 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 15 02:29:37.185854 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: dropping root privileges after socket binding Jan 15 02:29:37.185854 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: Python version: 3.6.9 (default, Oct 8 2020, 12:12:24) [GCC 8.4.0] Jan 15 02:29:37.230496 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: Python main interpreter initialized at 0x56444ec1c9c0 Jan 15 02:29:37.230496 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: dropping root privileges after plugin initialization Jan 15 02:29:37.230496 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: python threads support enabled Jan 15 02:29:37.230496 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: your server socket listen backlog is limited to 100 connections Jan 15 02:29:37.230496 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: your mercy for graceful operations on workers is 90 seconds Jan 15 02:29:37.231067 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: mapped 402621 bytes (393 KB) for 2 cores Jan 15 02:29:37.231067 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: *** Operational MODE: preforking *** Jan 15 02:29:37.231237 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: dropping root privileges after application loading Jan 15 02:29:37.231237 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: *** uWSGI is running in multiple interpreter mode *** Jan 15 02:29:37.231237 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: spawned uWSGI master process (pid: 79426) Jan 15 02:29:37.231484 dv-cinder-763306-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 15 02:29:37.232333 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: spawned uWSGI worker 1 (pid: 79427, cores: 1) Jan 15 02:29:37.232333 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: spawned uWSGI worker 2 (pid: 79428, cores: 1) Jan 15 02:29:37.232333 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 15 02:29:41.761037 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Jan 15 02:29:41.761630 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Jan 15 02:29:41.761738 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Jan 15 02:29:41.761816 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Jan 15 02:29:41.762899 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Jan 15 02:29:41.763339 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Jan 15 02:29:41.763459 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Jan 15 02:29:41.763632 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Jan 15 02:29:41.763740 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Jan 15 02:29:41.764033 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Jan 15 02:29:41.764156 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.764452 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.764557 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.764815 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.764939 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.765253 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.765377 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.765563 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.765670 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.765905 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.766004 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.766262 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.766365 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.766614 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.766713 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.766963 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.767066 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.767256 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.767362 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.767603 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.767701 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.767957 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.768310 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-763306-8-iscsi {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.768568 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.768671 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-763306-8-iscsi {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.768916 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.769048 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.769284 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.769383 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.769634 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.769737 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.769970 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.770068 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.770312 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.770410 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.770658 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.770763 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.770994 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.771268 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.771612 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.771726 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.771947 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.772056 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.772283 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.772380 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.772705 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.772812 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.773138 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.773331 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.773512 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.773626 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.773817 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.773921 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.774174 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.774282 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.774512 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.774616 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.774871 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.774969 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.775210 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.775310 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-763306-8-iscsi {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.775567 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.775665 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-763306-8-iscsi {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.775912 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.776016 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.776256 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.776362 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.776598 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.776752 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.777119 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.777230 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.777463 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.777562 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.777801 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.777899 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.778165 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.778264 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.778502 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.778610 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.778846 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.778945 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.779208 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.779312 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.779561 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.779670 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.779916 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.780014 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.780258 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.780362 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.780588 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.780692 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.780931 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.781078 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.781327 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.781425 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.781664 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.781765 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.782004 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.782106 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.782282 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.782381 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.782604 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.782702 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.782948 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.783045 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.783302 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.783449 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.783656 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.783761 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.783936 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.784048 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.784228 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.784326 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.784537 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.784636 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.784902 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.785027 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.785285 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.785440 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.785624 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.785733 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.785960 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.786058 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.786295 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.786413 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.786631 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.786740 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.786966 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.787064 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.787301 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.787399 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.787635 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.787740 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.787979 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.788083 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.788858 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.788971 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.789265 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.789466 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.789567 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.789660 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.789910 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.790008 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.790263 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.790371 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.790618 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.790716 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.790967 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.791083 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.791304 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.791403 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.791687 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.791784 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.792034 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.792138 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.792371 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.792470 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.792729 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.792833 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.793102 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.793207 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.793449 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.793548 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.793785 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.793888 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.794131 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.794235 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.794491 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.794591 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.794833 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.794942 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.795119 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.795225 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.795422 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.795529 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.795760 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.795864 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.796106 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.796213 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.796442 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.796539 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.796781 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.796886 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.797146 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.797262 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.797487 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.797585 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.797821 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.797920 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.798156 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.798290 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.798492 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.798597 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.798835 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.798934 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.799169 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.799278 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.799506 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.799604 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.799840 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.799938 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.800176 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.800274 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.800508 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.800606 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.800840 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.800937 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.801235 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.801336 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.801583 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.801681 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.801921 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.802028 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.802257 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.802355 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.802591 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.802695 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.802936 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.803036 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.803272 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.803376 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.803616 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.803714 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.804515 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.804810 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.804910 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.805037 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.805235 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.805342 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.805580 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.805690 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.805942 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.806040 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.806288 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.806386 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.806636 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.806741 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.806997 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.807095 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.807339 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.807437 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.807674 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.807782 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.808026 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.808123 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.808361 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.808459 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.808695 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.808803 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.809061 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.809177 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.809381 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.809488 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.809711 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.809810 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.810044 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.810147 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.810376 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.810477 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.810707 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.810806 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.811034 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.811131 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.811399 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.811506 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.811740 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.811823 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.812087 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.812193 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.812421 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.812518 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.812763 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.812861 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.813160 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.813262 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:29:41.813538 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.813653 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.813915 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.814021 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.814263 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.814369 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.814631 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.814737 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.815002 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.815100 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.815362 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.815459 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.815712 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.815827 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.816057 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.816161 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.816403 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.816501 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.816751 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.816849 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.817129 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.817230 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.817474 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.817573 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.817826 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.817933 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.818175 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.818272 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.818526 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.818623 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.818882 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.818981 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.819229 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.819332 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.819675 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.819785 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.820031 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.820109 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.820377 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.820484 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.820736 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.820835 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.821115 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.821218 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.821473 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.821580 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.821839 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.821929 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.822228 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.822327 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.822583 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.822689 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.822940 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.823038 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.823284 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.823391 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.823634 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.823739 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.823981 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.824094 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.824328 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.824430 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.824676 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.824783 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.825056 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.825158 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.825390 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.825499 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.825795 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.825941 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.826111 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.826220 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.826458 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.826565 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.826796 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.826894 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.827134 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.827233 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.827470 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.827574 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.827807 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.827905 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.828145 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.828242 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.828478 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.828577 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.828842 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.828940 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.829209 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.829318 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.829566 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.829665 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.829916 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.830014 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.830265 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.830370 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.830608 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.830706 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.830948 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.831052 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.831293 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.831406 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.831643 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.831742 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.831981 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.832127 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.832316 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.832423 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.832671 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.832770 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.833027 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.833130 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.833390 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.833500 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.833727 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.833825 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.834072 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.834178 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.834416 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.834524 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.834764 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.834862 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.835619 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.835790 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.835944 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.836096 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.836296 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.836400 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.836664 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.836764 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.837041 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.837154 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.837392 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.837489 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.837772 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.837876 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.838113 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.838211 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.838467 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.838563 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.838827 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.838925 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.839186 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.839289 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.839523 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.839620 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.839857 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.839962 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.840195 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.840297 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.840529 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.840632 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.840867 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.841055 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.841233 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.841337 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.841572 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.841662 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.841901 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.842019 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.842238 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.842346 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.842572 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.842677 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.842907 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.843012 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.843252 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.843354 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.843593 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.843690 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.843940 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.844057 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.844273 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.844391 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.844611 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.844716 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.844943 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.845074 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.845354 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.845458 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.845691 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.845788 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.846069 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.846178 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.846412 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.846510 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.846768 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.846865 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.847119 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.847218 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.847460 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.847557 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.847799 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.847896 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.848135 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.848233 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.848485 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.848582 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.848825 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.848928 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.849208 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.849316 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.849548 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.849645 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.849883 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.849981 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.850231 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.850330 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.850590 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.850694 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.851552 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.851730 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.851959 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.852057 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.852318 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.852443 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.852662 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.852805 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.853027 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.853131 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.853386 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.853486 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.853726 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.853841 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.854065 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.854176 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.854403 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.854561 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.854747 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.854854 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.855087 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.855185 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.855431 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.855531 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.855769 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.855874 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.856109 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.856207 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.856443 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.856541 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.856790 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.856894 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.857161 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.857263 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.857507 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.857607 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.857852 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.857952 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.858194 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.858311 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.858545 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.858651 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.858887 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.858992 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.859246 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.859350 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.859593 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.859699 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.859928 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.860034 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.860271 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.860375 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.860611 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.860724 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.860956 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.861142 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.861322 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.861427 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.861659 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.861777 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.861997 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.862104 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.862380 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.862472 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.862705 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.862819 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.863052 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.863149 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.863405 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.863501 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.863754 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.863859 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.864096 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.864193 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.864436 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.864535 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.864774 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.864874 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.865152 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.865258 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.865514 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.865612 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.865860 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.865964 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.866207 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.866328 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.867074 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.867253 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.867410 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.867571 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.867722 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.867881 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.868028 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.868175 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.868420 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.868572 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.868732 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.868886 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.869062 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.869212 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.869369 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.869528 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.869675 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.869823 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.870024 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.870192 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.870382 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.870712 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.871077 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.871224 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.871430 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.871586 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.871782 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.871946 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.872138 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.872287 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.872510 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.872671 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.872851 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.872950 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.873249 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.873350 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.873609 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.873709 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.873952 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.874050 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.874296 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.874395 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.874639 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.874753 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.874977 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.875092 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.875308 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.875407 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.875654 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.875753 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.875990 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.876088 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.876330 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.876428 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.876667 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.876766 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.877026 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.877140 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.877364 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.877463 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.877702 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.877807 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.878038 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.878136 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.878383 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.878549 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.878721 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.878827 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.879056 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.879161 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.879394 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.879501 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.879731 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.879835 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.880086 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.880185 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.880425 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.880531 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.880765 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.880867 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.881126 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.881228 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.881470 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.881580 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.881830 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.881939 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.882775 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.882890 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.883171 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.883279 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.883552 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.883656 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.883923 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.884030 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.884262 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.884367 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.884610 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.884709 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.884973 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.885120 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.885328 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.885428 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.885663 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.885762 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.886002 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.886101 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.886341 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.886492 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.886686 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.886785 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.887027 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.887136 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.887369 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.887468 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.887707 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.887805 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.888048 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.888153 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.888388 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.888491 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.888732 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.888839 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.889094 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.889217 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.889434 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.889533 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.889769 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.889868 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.890102 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.890209 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.890441 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.890545 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.890780 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.890879 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.891123 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.891233 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.891467 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.891573 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.891812 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.891911 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.892147 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.892257 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.892483 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.892582 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.892817 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.892922 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.893436 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.893540 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.893779 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.893878 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.894140 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.894239 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.894486 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.894585 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.894815 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.894913 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.895159 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.895257 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.895493 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.895592 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.895832 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.895937 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.896168 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.896266 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.896503 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.896602 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.896837 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.896935 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.897200 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.897326 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.897537 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.897642 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.897968 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.898066 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.898364 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.898470 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.898717 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.898815 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.899068 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.899166 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.899405 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.899514 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.899739 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.899843 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.900075 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.900173 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.900457 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.900562 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.900794 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.900893 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.901233 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.901336 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.901583 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.901696 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.901938 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.902037 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.902292 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.902396 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.902628 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.902734 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.902975 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.903085 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.903317 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.903416 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.903658 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.903758 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.903996 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.904095 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.904330 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.904435 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.904678 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.904782 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.905048 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.905150 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.905408 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.905508 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.905755 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.905855 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.906116 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.906215 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.906475 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.906573 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.906812 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.906910 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.907159 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.907258 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.907546 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.907651 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.907809 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.907910 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.908160 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.908258 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.908498 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.908604 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.908838 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.908936 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.909217 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.909324 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.909568 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.909688 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.909912 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.910010 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.910254 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.910352 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.910595 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.910704 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.910938 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.911040 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.911279 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.911378 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.911616 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.911725 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.911959 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.912063 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.912311 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.912410 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.912650 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.912749 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.913051 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.913195 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.913386 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.913491 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.913863 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.914022 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.914146 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.914243 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.914485 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.914635 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.914982 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.915082 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.915332 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.915498 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.915677 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.915783 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.916021 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.916120 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.916365 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.916469 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.916715 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.916820 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.917097 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.917201 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.917449 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.917558 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.917786 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.917930 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.918264 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.918363 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.918609 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.918708 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.918952 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.919058 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.919289 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.919387 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.919625 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.919781 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.919967 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.920074 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.920308 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.920412 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.920650 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.920748 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.920992 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.921129 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.921358 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.921457 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.921692 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.921790 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.922043 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.922142 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.922382 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.922480 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.922745 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.922844 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.923242 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.923352 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.923514 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.923613 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.923858 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.923995 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.924337 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.924437 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.924681 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.924783 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.925034 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.925137 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.925415 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.925515 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.925784 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.925897 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.926123 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.926233 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.926473 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.926571 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.926814 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.926913 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.927155 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.927264 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.927507 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.927604 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.927867 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.927965 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.928219 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.928324 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.928561 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.928659 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.929469 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.929611 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.929819 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.929930 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.930232 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.930331 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.930593 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.930693 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.930966 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.931066 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.931363 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.931461 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.931787 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.931915 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.932173 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.932299 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.932518 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.932623 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.932887 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.932991 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.933364 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.933476 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.933641 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.933739 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.933976 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.934073 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.934318 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.934418 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.934658 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.934762 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.935001 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.935100 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.935339 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.935439 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.935690 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.935788 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.936029 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.936134 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.936371 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.936475 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.936711 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.936810 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.937068 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.937182 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.937418 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.937523 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.937755 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.937852 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.938101 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.938210 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.938438 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.938536 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.938795 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.938894 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.939139 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.939247 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.939508 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.939605 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.939855 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.939953 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.940193 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.940298 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.940543 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.940641 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.940886 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.940984 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.941281 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.941382 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.941622 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.941754 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.941949 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.942055 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.942304 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.942404 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.942656 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.942754 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.943019 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.943116 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.943388 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.943502 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.943743 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.943852 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.944084 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.944189 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.944483 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.945228 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.945378 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.945656 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.945786 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.946042 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.946142 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.946399 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.946498 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.946744 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.946864 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.947088 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.947194 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.947423 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.947522 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.947768 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.947868 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.948108 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.948207 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.948449 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.948548 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.948787 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.948893 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.949150 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.949289 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.949496 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.949595 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.949833 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.949948 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.950176 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.950283 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.950533 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.950632 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.950870 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.950975 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.951206 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.951312 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.951552 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.951650 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.951888 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.951986 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.952241 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.952347 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.952584 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.952691 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.952962 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.953148 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.953329 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.953430 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.953692 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.953866 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.954043 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.954144 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.954385 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.954485 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.954753 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.954852 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.955094 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.955201 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.955451 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.955550 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.955803 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.955945 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.956154 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.956267 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.956501 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.956600 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.956848 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.956946 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.957227 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.957340 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.957572 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.957676 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.957921 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.958020 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.958273 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.958380 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.958621 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.958720 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.958980 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.959250 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.959357 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.959624 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.959935 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.960042 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.960846 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.960947 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.961314 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.961416 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.961672 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.961772 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.962031 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.962139 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.962382 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.962483 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.962727 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.962832 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.963069 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.963168 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.963412 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.963517 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.963758 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.963908 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.964112 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.964234 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.964461 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.964571 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.964829 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.964938 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.965253 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.965370 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.965615 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.965713 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.965974 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.966094 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.966322 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.966422 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.966676 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.966782 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.967022 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.967122 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.967383 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.967483 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.967753 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.967853 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.968113 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.968220 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.968453 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.968552 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.968814 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.968914 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.969195 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.969307 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.969546 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.969645 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.969896 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.969995 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.970247 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.970353 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.970593 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.970691 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.970936 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.971036 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.971283 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.971390 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.971627 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.971727 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.971969 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.972075 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.972325 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.972425 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.972692 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.972791 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.973089 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.973221 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.973446 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.973573 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.973791 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.973892 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.974143 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.974367 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.974474 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.974722 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.975058 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.975157 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.975418 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.975524 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.976336 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.976443 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.976810 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.976954 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.977214 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.977328 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.977560 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.977665 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.977909 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.978008 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.978256 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.978363 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.978600 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.978718 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.978938 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.979036 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.979275 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.979383 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.979616 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.979715 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.979957 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.980082 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.980299 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.980399 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.980648 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.980747 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.980992 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.981111 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.981372 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.981653 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.981753 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.982055 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.982323 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.982422 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.982730 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.982830 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.983093 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.983192 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.983447 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.983564 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.983800 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.983954 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.984155 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.984254 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.984494 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.984602 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.984844 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.984943 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.985217 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.985326 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.985569 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.985680 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.985915 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.986014 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.986257 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.986356 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.986598 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.986714 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.986934 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.987033 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.987269 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.987375 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.987610 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.987717 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.987945 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.988051 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.988286 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.988391 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.988629 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.988741 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.988964 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.989106 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.989339 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.989438 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.989677 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.989781 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.990013 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.990158 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.990355 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.990460 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.990730 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.990838 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.991009 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.991114 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.991371 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.991489 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.991721 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.991903 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.992080 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.992264 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.992425 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.992615 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.992775 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.992971 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.993147 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.993345 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.993503 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.993698 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.993851 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.994073 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.994182 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.994406 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.994506 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.994756 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.994861 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.995103 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.995202 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.995467 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.995566 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.995815 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.995914 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.996166 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.996265 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.996511 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.996663 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.996859 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.996959 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.997239 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.997341 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.997603 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.997712 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.997960 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.998215 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.998568 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.998667 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.998937 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.999098 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.999293 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.999392 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.999683 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:41.999781 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.000024 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.000130 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.000389 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.000504 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.000736 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.000882 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.001118 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.001237 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.001473 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.001571 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.001815 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.001914 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.002157 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.002267 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.002498 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.002606 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.002840 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.002945 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.003178 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.003285 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.003518 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.003617 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.003856 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.003956 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.004197 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.004332 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.004540 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.004659 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.004887 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.005214 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.005588 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.005690 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.005944 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.006044 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.006297 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.006403 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.006647 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.006747 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.007026 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.007181 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.007375 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.007570 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.007733 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.007835 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.008076 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.008175 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.008428 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.008535 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.008777 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.008876 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.009162 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.009264 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.009515 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.009639 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.009855 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.010018 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.010320 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.010481 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.010681 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.010848 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.011041 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.011199 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.011353 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.011502 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.011727 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.011878 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.012107 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.012268 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.012483 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.012645 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.012847 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.013039 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.013226 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.013384 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.013533 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.013684 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.013880 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.014030 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.014222 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.014381 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.014529 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.014688 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.014926 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.015028 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.015314 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.015414 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.015676 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.015783 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.016036 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.016136 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.016387 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.016494 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.016744 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.016897 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.017116 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.017219 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.017464 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.017571 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.017809 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.017916 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.018419 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.018526 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.018772 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.018871 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.019128 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.019237 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.019483 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.019583 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.019825 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.019925 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.020185 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.020293 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.020565 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.020675 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.020872 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.020972 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.021263 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.021365 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.021609 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.021708 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.021957 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.022056 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.022315 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.022423 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.023213 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.023390 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.023567 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.023668 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.023915 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.024016 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.024285 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.024418 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.024638 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.024772 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.025030 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.025134 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.025413 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.025513 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.025782 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.025890 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.026136 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.026235 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.026489 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.026589 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.026837 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.026976 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.027189 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.027290 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.027538 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.027646 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.027884 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.027992 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.028232 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.028340 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.028578 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.028679 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.028928 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.029050 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.029335 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.029435 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.029676 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.029787 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.030029 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.030128 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.030387 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.030486 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.030738 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.030840 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.031087 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.031186 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.031441 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.031539 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.031793 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.031900 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.032139 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.032244 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.032500 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.032599 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.032848 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.032956 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.033229 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.033330 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.033571 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.033671 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.033927 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.034039 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.034323 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.034479 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.034737 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.034850 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.035099 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.035216 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.035464 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.035563 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.035825 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.035924 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.036196 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.036296 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.036552 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.036651 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.036939 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.037074 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.037257 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=79427) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Jan 15 02:29:42.037387 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:29:42.037594 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=79428) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Jan 15 02:29:42.074629 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_db.sqlalchemy.engines [None req-7cf908fc-620a-43c9-9bb0-0aae25926154 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79428) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jan 15 02:29:42.075747 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_db.sqlalchemy.engines [None req-4bafd016-8af5-415e-b3a7-eb0c5255e987 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79427) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jan 15 02:29:42.419126 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.context [None req-4bafd016-8af5-415e-b3a7-eb0c5255e987 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),970f11a0-4ab6-42a9-9f4d-116f76c8b008(cell1) {{(pid=79427) load_cells /opt/stack/nova/nova/context.py:466}} Jan 15 02:29:42.421261 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.context [None req-7cf908fc-620a-43c9-9bb0-0aae25926154 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),970f11a0-4ab6-42a9-9f4d-116f76c8b008(cell1) {{(pid=79428) load_cells /opt/stack/nova/nova/context.py:466}} Jan 15 02:29:42.424573 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_concurrency.lockutils [None req-4bafd016-8af5-415e-b3a7-eb0c5255e987 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79427) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:29:42.426445 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_concurrency.lockutils [None req-4bafd016-8af5-415e-b3a7-eb0c5255e987 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=79427) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:29:42.426687 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_concurrency.lockutils [None req-7cf908fc-620a-43c9-9bb0-0aae25926154 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79428) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:29:42.427320 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_concurrency.lockutils [None req-4bafd016-8af5-415e-b3a7-eb0c5255e987 None None] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79427) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:29:42.428512 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_concurrency.lockutils [None req-7cf908fc-620a-43c9-9bb0-0aae25926154 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=79428) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:29:42.430037 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_concurrency.lockutils [None req-7cf908fc-620a-43c9-9bb0-0aae25926154 None None] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79428) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:29:42.430277 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_concurrency.lockutils [None req-4bafd016-8af5-415e-b3a7-eb0c5255e987 None None] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=79427) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:29:42.432139 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_concurrency.lockutils [None req-7cf908fc-620a-43c9-9bb0-0aae25926154 None None] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=79428) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:29:42.453874 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_db.sqlalchemy.engines [None req-4bafd016-8af5-415e-b3a7-eb0c5255e987 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79427) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jan 15 02:29:42.455523 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_db.sqlalchemy.engines [None req-7cf908fc-620a-43c9-9bb0-0aae25926154 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79428) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jan 15 02:29:42.462758 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_db.sqlalchemy.engines [None req-7cf908fc-620a-43c9-9bb0-0aae25926154 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79428) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jan 15 02:29:42.463548 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_db.sqlalchemy.engines [None req-4bafd016-8af5-415e-b3a7-eb0c5255e987 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79427) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jan 15 02:29:42.489930 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_db.sqlalchemy.engines [None req-4bafd016-8af5-415e-b3a7-eb0c5255e987 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79427) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jan 15 02:29:42.490838 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_db.sqlalchemy.engines [None req-7cf908fc-620a-43c9-9bb0-0aae25926154 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79428) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jan 15 02:29:42.666263 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO keyring.backend [None req-4bafd016-8af5-415e-b3a7-eb0c5255e987 None None] Loading Gnome Jan 15 02:29:42.666516 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO keyring.backend [None req-7cf908fc-620a-43c9-9bb0-0aae25926154 None None] Loading Gnome Jan 15 02:29:42.687467 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO keyring.backend [None req-4bafd016-8af5-415e-b3a7-eb0c5255e987 None None] Loading Google Jan 15 02:29:42.687621 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO keyring.backend [None req-7cf908fc-620a-43c9-9bb0-0aae25926154 None None] Loading Google Jan 15 02:29:42.690640 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO keyring.backend [None req-7cf908fc-620a-43c9-9bb0-0aae25926154 None None] Loading Windows (alt) Jan 15 02:29:42.690758 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO keyring.backend [None req-4bafd016-8af5-415e-b3a7-eb0c5255e987 None None] Loading Windows (alt) Jan 15 02:29:42.695761 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO keyring.backend [None req-4bafd016-8af5-415e-b3a7-eb0c5255e987 None None] Loading file Jan 15 02:29:42.696081 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO keyring.backend [None req-7cf908fc-620a-43c9-9bb0-0aae25926154 None None] Loading file Jan 15 02:29:42.696932 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO keyring.backend [None req-4bafd016-8af5-415e-b3a7-eb0c5255e987 None None] Loading keyczar Jan 15 02:29:42.697203 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO keyring.backend [None req-7cf908fc-620a-43c9-9bb0-0aae25926154 None None] Loading keyczar Jan 15 02:29:42.697406 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO keyring.backend [None req-4bafd016-8af5-415e-b3a7-eb0c5255e987 None None] Loading multi Jan 15 02:29:42.697649 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO keyring.backend [None req-7cf908fc-620a-43c9-9bb0-0aae25926154 None None] Loading multi Jan 15 02:29:42.698289 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO keyring.backend [None req-4bafd016-8af5-415e-b3a7-eb0c5255e987 None None] Loading pyfs Jan 15 02:29:42.698521 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO keyring.backend [None req-7cf908fc-620a-43c9-9bb0-0aae25926154 None None] Loading pyfs Jan 15 02:29:42.979590 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: WARNING keystonemiddleware.auth_token [None req-4bafd016-8af5-415e-b3a7-eb0c5255e987 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 15 02:29:42.981375 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: WARNING keystonemiddleware.auth_token [None req-7cf908fc-620a-43c9-9bb0-0aae25926154 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 15 02:29:42.987068 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: WARNING keystonemiddleware.auth_token [None req-4bafd016-8af5-415e-b3a7-eb0c5255e987 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 15 02:29:42.988796 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: WARNING keystonemiddleware.auth_token [None req-7cf908fc-620a-43c9-9bb0-0aae25926154 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 15 02:29:43.323093 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: WARNING keystonemiddleware.auth_token [None req-4bafd016-8af5-415e-b3a7-eb0c5255e987 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 15 02:29:43.327035 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: WARNING keystonemiddleware.auth_token [None req-7cf908fc-620a-43c9-9bb0-0aae25926154 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 15 02:29:43.328661 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: WARNING keystonemiddleware.auth_token [None req-4bafd016-8af5-415e-b3a7-eb0c5255e987 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 15 02:29:43.332726 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: WARNING keystonemiddleware.auth_token [None req-7cf908fc-620a-43c9-9bb0-0aae25926154 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 15 02:29:43.334208 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56444ec1c9c0 pid: 79427 (default app) Jan 15 02:29:43.336969 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-4bafd016-8af5-415e-b3a7-eb0c5255e987 None None] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:29:43.338180 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-4bafd016-8af5-415e-b3a7-eb0c5255e987 None None] 10.222.0.37 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001814 Jan 15 02:29:43.338615 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 1/1] 10.222.0.37 () {50 vars in 779 bytes} [Fri Jan 15 02:29:43 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:29:43.339011 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56444ec1c9c0 pid: 79428 (default app) Jan 15 02:31:14.709994 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-2cda3f9a-3e73-4ed7-8d23-070df2fd9be7 admin admin] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:31:14.735932 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-2cda3f9a-3e73-4ed7-8d23-070df2fd9be7 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail" status: 200 len: 15 microversion: 2.1 time: 0.525316 Jan 15 02:31:14.736567 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 2/2] 10.222.0.37 () {58 vars in 1150 bytes} [Fri Jan 15 02:31:14 2021] GET /compute/v2.1/flavors/detail => generated 15 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:31:17.656791 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-259277b5-ec8f-4b3d-ab18-9c26c163951c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "vcpus": 1, "disk": 1, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:31:17.687229 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:31:17.687229 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: warnings.warn(msg) Jan 15 02:31:17.715434 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-259277b5-ec8f-4b3d-ab18-9c26c163951c admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 367 microversion: 2.1 time: 0.418770 Jan 15 02:31:17.716067 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 1/3] 10.222.0.37 () {62 vars in 1183 bytes} [Fri Jan 15 02:31:17 2021] POST /compute/v2.1/flavors => generated 367 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:31:17.732422 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-721830ae-110d-4e52-af94-c5150413f111 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:31:17.740347 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:31:17.740347 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: warnings.warn(msg) Jan 15 02:31:17.779572 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-721830ae-110d-4e52-af94-c5150413f111 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.056290 Jan 15 02:31:17.780198 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 3/4] 10.222.0.37 () {62 vars in 1236 bytes} [Fri Jan 15 02:31:17 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:31:17.795598 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-3f65b00d-ddb7-4793-b799-9c7844b49472 admin admin] Calling method '>' {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:31:17.819403 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-3f65b00d-ddb7-4793-b799-9c7844b49472 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.032760 Jan 15 02:31:17.819994 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 2/5] 10.222.0.37 () {58 vars in 1183 bytes} [Fri Jan 15 02:31:17 2021] GET /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:31:20.472225 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-5e2f03f8-a530-48c8-baf3-e9b67820352e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "vcpus": 1, "disk": 5, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:31:20.501476 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:31:20.501476 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: warnings.warn(msg) Jan 15 02:31:20.526546 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-5e2f03f8-a530-48c8-baf3-e9b67820352e admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.145235 Jan 15 02:31:20.527172 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 4/6] 10.222.0.37 () {62 vars in 1183 bytes} [Fri Jan 15 02:31:20 2021] POST /compute/v2.1/flavors => generated 364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:31:20.543047 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-bca16b5a-1ee1-4a70-9e25-3d153ee63607 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:31:20.549397 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:31:20.549397 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: warnings.warn(msg) Jan 15 02:31:20.588405 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-bca16b5a-1ee1-4a70-9e25-3d153ee63607 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.054168 Jan 15 02:31:20.589055 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 3/7] 10.222.0.37 () {62 vars in 1236 bytes} [Fri Jan 15 02:31:20 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:31:20.604550 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-3743c888-1c1d-4d37-90c9-7a17b6e8a22c admin admin] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:31:20.625636 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-3743c888-1c1d-4d37-90c9-7a17b6e8a22c admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030116 Jan 15 02:31:20.626383 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 5/8] 10.222.0.37 () {58 vars in 1183 bytes} [Fri Jan 15 02:31:20 2021] GET /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:31:23.305313 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-b94897d3-d2e3-4a1d-bafd-984b81067ad5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "vcpus": 1, "disk": 10, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:31:23.332048 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-b94897d3-d2e3-4a1d-bafd-984b81067ad5 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.118109 Jan 15 02:31:23.332674 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 4/9] 10.222.0.37 () {62 vars in 1183 bytes} [Fri Jan 15 02:31:23 2021] POST /compute/v2.1/flavors => generated 364 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:31:23.349050 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-8ff1ef88-dc4a-4ea0-a3ba-94bd6fab6b87 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:31:23.390105 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-8ff1ef88-dc4a-4ea0-a3ba-94bd6fab6b87 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.050466 Jan 15 02:31:23.390738 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 6/10] 10.222.0.37 () {62 vars in 1236 bytes} [Fri Jan 15 02:31:23 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:31:23.406063 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-a007d03c-5f8e-4098-a98b-79c575db99f0 admin admin] Calling method '>' {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:31:23.427629 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-a007d03c-5f8e-4098-a98b-79c575db99f0 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030298 Jan 15 02:31:23.428215 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 5/11] 10.222.0.37 () {58 vars in 1183 bytes} [Fri Jan 15 02:31:23 2021] GET /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:31:26.085186 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-6dafee3f-ed35-48cf-a8b9-19d0945c7e97 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "vcpus": 2, "disk": 10, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:31:26.112766 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-6dafee3f-ed35-48cf-a8b9-19d0945c7e97 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.118290 Jan 15 02:31:26.113501 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 7/12] 10.222.0.37 () {62 vars in 1183 bytes} [Fri Jan 15 02:31:25 2021] POST /compute/v2.1/flavors => generated 364 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:31:26.129972 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-ea9f36e3-8c95-41c7-b441-6c901e0234e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:31:26.171547 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-ea9f36e3-8c95-41c7-b441-6c901e0234e3 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.051033 Jan 15 02:31:26.172181 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 6/13] 10.222.0.37 () {62 vars in 1236 bytes} [Fri Jan 15 02:31:26 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:31:26.187435 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-1abd12fe-9ff0-4ff5-aae2-f6c66d4f30b4 admin admin] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:31:26.208876 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-1abd12fe-9ff0-4ff5-aae2-f6c66d4f30b4 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030211 Jan 15 02:31:26.209526 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 8/14] 10.222.0.37 () {58 vars in 1183 bytes} [Fri Jan 15 02:31:26 2021] GET /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:31:28.826640 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-69076ab9-5606-45c1-808d-5a3dde329bb1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "vcpus": 4, "disk": 20, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:31:28.854829 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-69076ab9-5606-45c1-808d-5a3dde329bb1 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.117850 Jan 15 02:31:28.855363 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 7/15] 10.222.0.37 () {62 vars in 1183 bytes} [Fri Jan 15 02:31:28 2021] POST /compute/v2.1/flavors => generated 364 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:31:28.871233 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-ee9db947-a064-492d-ace2-075c19143850 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:31:28.912597 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-ee9db947-a064-492d-ace2-075c19143850 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.050251 Jan 15 02:31:28.913247 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 9/16] 10.222.0.37 () {62 vars in 1236 bytes} [Fri Jan 15 02:31:28 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 02:31:28.929112 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-74b71769-40e2-47e9-9363-4ef5e79c6f5f admin admin] Calling method '>' {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:31:28.950010 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-74b71769-40e2-47e9-9363-4ef5e79c6f5f admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030472 Jan 15 02:31:28.950593 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 8/17] 10.222.0.37 () {58 vars in 1183 bytes} [Fri Jan 15 02:31:28 2021] GET /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:31:31.636202 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-4f214e9c-4b4b-46c7-b762-a663fb025b21 admin admin] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:31:31.658757 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-4f214e9c-4b4b-46c7-b762-a663fb025b21 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail" status: 200 len: 1786 microversion: 2.1 time: 0.113404 Jan 15 02:31:31.659880 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 10/18] 10.222.0.37 () {58 vars in 1150 bytes} [Fri Jan 15 02:31:31 2021] GET /compute/v2.1/flavors/detail => generated 1786 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:31:34.273852 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-4e9dbaa2-3cd7-472c-846c-d3100160a709 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "vcpus": 1, "disk": 1, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:31:34.301160 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-4e9dbaa2-3cd7-472c-846c-d3100160a709 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 362 microversion: 2.1 time: 0.116263 Jan 15 02:31:34.301783 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 9/19] 10.222.0.37 () {62 vars in 1183 bytes} [Fri Jan 15 02:31:34 2021] POST /compute/v2.1/flavors => generated 362 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:31:34.317843 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-a66065db-ced2-4ee5-a384-9461304e3412 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:31:34.359568 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-a66065db-ced2-4ee5-a384-9461304e3412 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.050587 Jan 15 02:31:34.360209 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 11/20] 10.222.0.37 () {62 vars in 1233 bytes} [Fri Jan 15 02:31:34 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:31:34.376037 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-6b8ce65b-d2c2-43a4-a11d-56c4b4b15824 admin admin] Calling method '>' {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:31:34.399076 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-6b8ce65b-d2c2-43a4-a11d-56c4b4b15824 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.031841 Jan 15 02:31:34.399684 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 10/21] 10.222.0.37 () {58 vars in 1180 bytes} [Fri Jan 15 02:31:34 2021] GET /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:31:37.110182 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-f45648e8-9454-4682-853d-896bbb754511 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "vcpus": 1, "disk": 20, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:31:37.139677 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-f45648e8-9454-4682-853d-896bbb754511 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.166407 Jan 15 02:31:37.140318 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 12/22] 10.222.0.37 () {62 vars in 1183 bytes} [Fri Jan 15 02:31:36 2021] POST /compute/v2.1/flavors => generated 365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:31:37.157069 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-df8e496c-647a-405d-93dc-511be1a23b69 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:31:37.199068 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-df8e496c-647a-405d-93dc-511be1a23b69 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.050807 Jan 15 02:31:37.199636 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 11/23] 10.222.0.37 () {62 vars in 1233 bytes} [Fri Jan 15 02:31:37 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:31:37.215011 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-904bfa3f-0fb7-4d44-8c60-1f50de37f744 admin admin] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:31:37.235665 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-904bfa3f-0fb7-4d44-8c60-1f50de37f744 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.029499 Jan 15 02:31:37.236271 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 13/24] 10.222.0.37 () {58 vars in 1180 bytes} [Fri Jan 15 02:31:37 2021] GET /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:31:39.913252 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-f59be6d8-8bef-4dad-8f2f-72012b5d8b78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "vcpus": 2, "disk": 40, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:31:39.941133 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-f59be6d8-8bef-4dad-8f2f-72012b5d8b78 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 366 microversion: 2.1 time: 0.115795 Jan 15 02:31:39.941719 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 12/25] 10.222.0.37 () {62 vars in 1183 bytes} [Fri Jan 15 02:31:39 2021] POST /compute/v2.1/flavors => generated 366 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:31:39.958030 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-0f87454a-e9c9-401d-8571-e2351b03b363 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:31:39.999059 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-0f87454a-e9c9-401d-8571-e2351b03b363 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.050385 Jan 15 02:31:39.999692 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 14/26] 10.222.0.37 () {62 vars in 1233 bytes} [Fri Jan 15 02:31:39 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:31:40.015237 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-f970b5df-04c9-47fa-9ccb-7f04fd48db21 admin admin] Calling method '>' {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:31:40.036944 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-f970b5df-04c9-47fa-9ccb-7f04fd48db21 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030351 Jan 15 02:31:40.037561 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 13/27] 10.222.0.37 () {58 vars in 1180 bytes} [Fri Jan 15 02:31:40 2021] GET /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:31:42.660508 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-dc330e90-a574-434c-84e8-a0d8a9860fb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "vcpus": 4, "disk": 80, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:31:42.688417 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-dc330e90-a574-434c-84e8-a0d8a9860fb7 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.115800 Jan 15 02:31:42.689134 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 15/28] 10.222.0.37 () {62 vars in 1183 bytes} [Fri Jan 15 02:31:42 2021] POST /compute/v2.1/flavors => generated 365 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:31:42.704946 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-de0adcb1-fbcd-4311-b223-e57ffcac4537 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:31:42.748215 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-de0adcb1-fbcd-4311-b223-e57ffcac4537 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.051990 Jan 15 02:31:42.748871 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 14/29] 10.222.0.37 () {62 vars in 1233 bytes} [Fri Jan 15 02:31:42 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:31:42.764855 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-ac77bf35-ad37-43e1-9d7f-caeab5ade800 admin admin] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:31:42.788476 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-ac77bf35-ad37-43e1-9d7f-caeab5ade800 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.032410 Jan 15 02:31:42.789121 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 16/30] 10.222.0.37 () {58 vars in 1180 bytes} [Fri Jan 15 02:31:42 2021] GET /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:31:45.438117 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-511c309e-b266-4166-8701-bcef89a1b674 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "vcpus": 8, "disk": 160, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:31:45.467636 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-511c309e-b266-4166-8701-bcef89a1b674 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 368 microversion: 2.1 time: 0.116419 Jan 15 02:31:45.468182 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 15/31] 10.222.0.37 () {62 vars in 1183 bytes} [Fri Jan 15 02:31:45 2021] POST /compute/v2.1/flavors => generated 368 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:31:45.485566 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-c5331ede-f4a2-4d4e-8f74-cfd66b21b17d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:31:45.531550 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-c5331ede-f4a2-4d4e-8f74-cfd66b21b17d admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.055338 Jan 15 02:31:45.532233 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 17/32] 10.222.0.37 () {62 vars in 1233 bytes} [Fri Jan 15 02:31:45 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 02:31:45.548387 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-284bccce-bea1-404b-b224-13f86fbb09e7 admin admin] Calling method '>' {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:31:45.569477 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-284bccce-bea1-404b-b224-13f86fbb09e7 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030055 Jan 15 02:31:45.570088 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 16/33] 10.222.0.37 () {58 vars in 1180 bytes} [Fri Jan 15 02:31:45 2021] GET /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:32:58.950539 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-d9d6da77-dc5c-44f0-94bf-a5377caf4f89 admin admin] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:32:58.975366 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-d9d6da77-dc5c-44f0-94bf-a5377caf4f89 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail" status: 200 len: 3562 microversion: 2.1 time: 0.114744 Jan 15 02:32:58.975981 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 18/34] 10.222.0.37 () {58 vars in 1150 bytes} [Fri Jan 15 02:32:58 2021] GET /compute/v2.1/flavors/detail => generated 3562 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:33:00.649429 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-284bccce-bea1-404b-b224-13f86fbb09e7 admin admin] Calling method '>' {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:33:00.650607 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-284bccce-bea1-404b-b224-13f86fbb09e7 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Jan 15 02:33:00.651057 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 17/35] 10.222.0.37 () {56 vars in 1065 bytes} [Fri Jan 15 02:33:00 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:33:00.869706 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-ed9c4c85-2719-473d-8afb-762baf95e33d admin admin] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:33:00.884339 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.wsgi [None req-ed9c4c85-2719-473d-8afb-762baf95e33d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 15 02:33:00.884995 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-ed9c4c85-2719-473d-8afb-762baf95e33d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=79427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:33:00.885912 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-ed9c4c85-2719-473d-8afb-762baf95e33d admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.106836 Jan 15 02:33:00.886501 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 19/36] 10.222.0.37 () {60 vars in 1181 bytes} [Fri Jan 15 02:33:00 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 15 02:33:00.901905 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-51ad1427-3af3-453b-9c61-31d1d4a708de admin admin] Calling method '>' {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:33:00.924690 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-51ad1427-3af3-453b-9c61-31d1d4a708de admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.031954 Jan 15 02:33:00.925331 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 18/37] 10.222.0.37 () {60 vars in 1201 bytes} [Fri Jan 15 02:33:00 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:33:00.940950 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-21ee76ca-77a1-4ae0-9cd9-383bb7c7f354 admin admin] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:33:00.963095 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-21ee76ca-77a1-4ae0-9cd9-383bb7c7f354 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.031085 Jan 15 02:33:00.963707 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 20/38] 10.222.0.37 () {60 vars in 1201 bytes} [Fri Jan 15 02:33:00 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:33:00.979677 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-7bdee5df-284b-4309-8a1e-c769d571e41b admin admin] Calling method '>' {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:33:00.994171 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.wsgi [None req-7bdee5df-284b-4309-8a1e-c769d571e41b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 15 02:33:00.994812 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-7bdee5df-284b-4309-8a1e-c769d571e41b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=79428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:33:00.995661 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-7bdee5df-284b-4309-8a1e-c769d571e41b admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.025387 Jan 15 02:33:00.996300 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 19/39] 10.222.0.37 () {60 vars in 1181 bytes} [Fri Jan 15 02:33:00 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 15 02:33:02.582802 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-21ee76ca-77a1-4ae0-9cd9-383bb7c7f354 admin admin] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:33:02.583886 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-21ee76ca-77a1-4ae0-9cd9-383bb7c7f354 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Jan 15 02:33:02.584328 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 21/40] 10.222.0.37 () {56 vars in 1065 bytes} [Fri Jan 15 02:33:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:33:02.803232 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-6ca4d1cb-6dbe-4a9f-b84c-b84ce9a3cf9e admin admin] Calling method '>' {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:33:02.817282 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.wsgi [None req-6ca4d1cb-6dbe-4a9f-b84c-b84ce9a3cf9e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 15 02:33:02.817900 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-6ca4d1cb-6dbe-4a9f-b84c-b84ce9a3cf9e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=79428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:33:02.818742 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-6ca4d1cb-6dbe-4a9f-b84c-b84ce9a3cf9e admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.105636 Jan 15 02:33:02.819315 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 20/41] 10.222.0.37 () {60 vars in 1181 bytes} [Fri Jan 15 02:33:02 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 15 02:33:02.835352 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-174dfbcf-6bed-4a34-9fca-cb076c2a874d admin admin] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:33:02.857043 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-174dfbcf-6bed-4a34-9fca-cb076c2a874d admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.031371 Jan 15 02:33:02.857656 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 22/42] 10.222.0.37 () {60 vars in 1201 bytes} [Fri Jan 15 02:33:02 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:33:02.873344 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-0203c021-93f1-417b-bfa5-0abda132338b admin admin] Calling method '>' {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:33:02.897488 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-0203c021-93f1-417b-bfa5-0abda132338b admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.032771 Jan 15 02:33:02.898107 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 21/43] 10.222.0.37 () {60 vars in 1201 bytes} [Fri Jan 15 02:33:02 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:33:02.913570 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-543e959c-7211-4dc7-af0e-a07aec357905 admin admin] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:33:02.926879 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.wsgi [None req-543e959c-7211-4dc7-af0e-a07aec357905 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 15 02:33:02.927443 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-543e959c-7211-4dc7-af0e-a07aec357905 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=79427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:33:02.928299 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-543e959c-7211-4dc7-af0e-a07aec357905 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.023549 Jan 15 02:33:02.928867 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 23/44] 10.222.0.37 () {60 vars in 1181 bytes} [Fri Jan 15 02:33:02 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 15 02:33:04.487214 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-0203c021-93f1-417b-bfa5-0abda132338b admin admin] Calling method '>' {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:33:04.488287 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-0203c021-93f1-417b-bfa5-0abda132338b admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Jan 15 02:33:04.488720 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 22/45] 10.222.0.37 () {56 vars in 1065 bytes} [Fri Jan 15 02:33:04 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:33:04.707570 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-148c351b-1dcd-41df-9046-5b68558bba7f admin admin] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:33:04.720996 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.wsgi [None req-148c351b-1dcd-41df-9046-5b68558bba7f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 15 02:33:04.721653 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-148c351b-1dcd-41df-9046-5b68558bba7f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=79427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:33:04.722525 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-148c351b-1dcd-41df-9046-5b68558bba7f admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.104878 Jan 15 02:33:04.723113 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 24/46] 10.222.0.37 () {60 vars in 1184 bytes} [Fri Jan 15 02:33:04 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 15 02:33:04.739424 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-becf3f51-996e-430d-8ec2-9ca2b2a5ed97 admin admin] Calling method '>' {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:33:04.762319 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-becf3f51-996e-430d-8ec2-9ca2b2a5ed97 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.032777 Jan 15 02:33:04.762953 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 23/47] 10.222.0.37 () {60 vars in 1201 bytes} [Fri Jan 15 02:33:04 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:33:04.779285 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-6e3263a9-3d21-43c1-b47d-2f4a8b970e1a admin admin] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:33:04.801799 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-6e3263a9-3d21-43c1-b47d-2f4a8b970e1a admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.031247 Jan 15 02:33:04.802420 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 25/48] 10.222.0.37 () {60 vars in 1201 bytes} [Fri Jan 15 02:33:04 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:33:04.818646 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-fecc385e-d2c2-4219-9b8c-800b41ffce5a admin admin] Calling method '>' {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:33:04.831875 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.wsgi [None req-fecc385e-d2c2-4219-9b8c-800b41ffce5a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 15 02:33:04.832495 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-fecc385e-d2c2-4219-9b8c-800b41ffce5a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=79428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:33:04.833370 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-fecc385e-d2c2-4219-9b8c-800b41ffce5a admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.024404 Jan 15 02:33:04.834014 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 24/49] 10.222.0.37 () {60 vars in 1184 bytes} [Fri Jan 15 02:33:04 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 15 02:33:06.430611 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-6e3263a9-3d21-43c1-b47d-2f4a8b970e1a admin admin] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:33:06.431694 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-6e3263a9-3d21-43c1-b47d-2f4a8b970e1a admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Jan 15 02:33:06.432134 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 26/50] 10.222.0.37 () {56 vars in 1065 bytes} [Fri Jan 15 02:33:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:33:06.659476 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-586b7023-1953-4ab1-98e2-7b3ceff7754a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:33:06.694624 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-586b7023-1953-4ab1-98e2-7b3ceff7754a admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.87 time: 0.133495 Jan 15 02:33:06.695250 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 25/51] 10.222.0.37 () {64 vars in 1226 bytes} [Fri Jan 15 02:33:06 2021] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:33:08.297168 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-6e3263a9-3d21-43c1-b47d-2f4a8b970e1a admin admin] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:33:08.298588 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-6e3263a9-3d21-43c1-b47d-2f4a8b970e1a admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001889 Jan 15 02:33:08.299022 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 27/52] 10.222.0.37 () {56 vars in 1065 bytes} [Fri Jan 15 02:33:08 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:33:08.522315 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-10d7293f-e180-42b8-8437-f2c35be5a4eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:33:08.558169 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-10d7293f-e180-42b8-8437-f2c35be5a4eb admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.87 time: 0.126089 Jan 15 02:33:08.558813 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 26/53] 10.222.0.37 () {64 vars in 1226 bytes} [Fri Jan 15 02:33:08 2021] POST /compute/v2.1/flavors => generated 405 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:33:10.133540 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-6e3263a9-3d21-43c1-b47d-2f4a8b970e1a admin admin] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:33:10.134704 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-6e3263a9-3d21-43c1-b47d-2f4a8b970e1a admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001634 Jan 15 02:33:10.135141 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 28/54] 10.222.0.37 () {56 vars in 1065 bytes} [Fri Jan 15 02:33:10 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:33:10.355012 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-bd22adea-ca0b-4e72-9ba9-d2bc8e7ccdf8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:33:10.389228 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-bd22adea-ca0b-4e72-9ba9-d2bc8e7ccdf8 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.87 time: 0.125834 Jan 15 02:33:10.389833 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 27/55] 10.222.0.37 () {64 vars in 1226 bytes} [Fri Jan 15 02:33:10 2021] POST /compute/v2.1/flavors => generated 407 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:33:11.963827 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-6e3263a9-3d21-43c1-b47d-2f4a8b970e1a admin admin] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:33:11.964946 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-6e3263a9-3d21-43c1-b47d-2f4a8b970e1a admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Jan 15 02:33:11.965416 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 29/56] 10.222.0.37 () {56 vars in 1065 bytes} [Fri Jan 15 02:33:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:33:12.181375 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-3dbb212f-96fe-44ae-b4f9-097bea1cf6d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:33:12.215077 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-3dbb212f-96fe-44ae-b4f9-097bea1cf6d9 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.87 time: 0.122695 Jan 15 02:33:12.215673 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 28/57] 10.222.0.37 () {64 vars in 1226 bytes} [Fri Jan 15 02:33:12 2021] POST /compute/v2.1/flavors => generated 409 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:33:13.809185 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-6e3263a9-3d21-43c1-b47d-2f4a8b970e1a admin admin] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:33:13.810315 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-6e3263a9-3d21-43c1-b47d-2f4a8b970e1a admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001614 Jan 15 02:33:13.810757 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 30/58] 10.222.0.37 () {56 vars in 1065 bytes} [Fri Jan 15 02:33:13 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:33:14.031116 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-f5da8d25-e4de-4d8d-868d-e85430dabc77 admin admin] Calling method '>' {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:33:14.072696 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-f5da8d25-e4de-4d8d-868d-e85430dabc77 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.129599 Jan 15 02:33:14.073333 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 29/59] 10.222.0.37 () {60 vars in 1193 bytes} [Fri Jan 15 02:33:13 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:34:05.524587 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-6e3263a9-3d21-43c1-b47d-2f4a8b970e1a admin admin] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:34:05.525744 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-6e3263a9-3d21-43c1-b47d-2f4a8b970e1a admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Jan 15 02:34:05.526185 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 31/60] 10.222.0.37 () {56 vars in 1065 bytes} [Fri Jan 15 02:34:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:34:05.752305 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-9d179a53-5538-4a58-b5ce-ea8d65c084d3 admin admin] Calling method '>' {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:34:05.788229 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-9d179a53-5538-4a58-b5ce-ea8d65c084d3 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.129814 Jan 15 02:34:05.788859 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 30/61] 10.222.0.37 () {60 vars in 1193 bytes} [Fri Jan 15 02:34:05 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:35:28.191731 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-ea5ce7f2-04d2-4605-a69f-4520100a29ac tempest-verify_tempest_config-638042944 tempest-verify_tempest_config-638042944] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:35:28.198582 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-ea5ce7f2-04d2-4605-a69f-4520100a29ac tempest-verify_tempest_config-638042944 tempest-verify_tempest_config-638042944] 10.222.0.37 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.163684 Jan 15 02:35:28.199173 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 32/62] 10.222.0.37 () {58 vars in 1124 bytes} [Fri Jan 15 02:35:28 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:36:59.255490 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-9d179a53-5538-4a58-b5ce-ea8d65c084d3 admin admin] Calling method '>' {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:36:59.256574 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-9d179a53-5538-4a58-b5ce-ea8d65c084d3 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 Jan 15 02:36:59.257036 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 31/63] 10.222.0.37 () {56 vars in 1065 bytes} [Fri Jan 15 02:36:59 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:36:59.556191 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-ae1a9fe0-07d5-44f9-9f13-6fa4f2555e7a admin admin] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:36:59.562262 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:36:59.562262 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: warnings.warn(msg) Jan 15 02:36:59.564495 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_concurrency.lockutils [None req-ae1a9fe0-07d5-44f9-9f13-6fa4f2555e7a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79427) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:36:59.564991 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_concurrency.lockutils [None req-ae1a9fe0-07d5-44f9-9f13-6fa4f2555e7a admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=79427) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:36:59.565890 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_concurrency.lockutils [None req-ae1a9fe0-07d5-44f9-9f13-6fa4f2555e7a admin admin] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79427) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:36:59.566371 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_concurrency.lockutils [None req-ae1a9fe0-07d5-44f9-9f13-6fa4f2555e7a admin admin] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=79427) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:36:59.602482 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-ae1a9fe0-07d5-44f9-9f13-6fa4f2555e7a admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.211445 Jan 15 02:36:59.603105 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 33/64] 10.222.0.37 () {60 vars in 1184 bytes} [Fri Jan 15 02:36:59 2021] GET /compute/v2.1/os-services => generated 791 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:37:01.237895 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-9d179a53-5538-4a58-b5ce-ea8d65c084d3 admin admin] Calling method '>' {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:37:01.238962 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-9d179a53-5538-4a58-b5ce-ea8d65c084d3 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Jan 15 02:37:01.239394 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 32/65] 10.222.0.37 () {56 vars in 1065 bytes} [Fri Jan 15 02:37:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:37:01.460994 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-836c55fc-4d93-4769-8e7e-28d26785d019 admin admin] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:37:01.467150 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:37:01.467150 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: warnings.warn(msg) Jan 15 02:37:01.468744 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_concurrency.lockutils [None req-836c55fc-4d93-4769-8e7e-28d26785d019 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79427) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:37:01.469264 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_concurrency.lockutils [None req-836c55fc-4d93-4769-8e7e-28d26785d019 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=79427) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:37:01.470172 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_concurrency.lockutils [None req-836c55fc-4d93-4769-8e7e-28d26785d019 admin admin] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79427) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:37:01.470638 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_concurrency.lockutils [None req-836c55fc-4d93-4769-8e7e-28d26785d019 admin admin] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=79427) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:37:01.496369 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-836c55fc-4d93-4769-8e7e-28d26785d019 admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.125138 Jan 15 02:37:01.496983 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 34/66] 10.222.0.37 () {60 vars in 1184 bytes} [Fri Jan 15 02:37:01 2021] GET /compute/v2.1/os-services => generated 791 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:37:13.503075 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-9d179a53-5538-4a58-b5ce-ea8d65c084d3 admin admin] Calling method '>' {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:37:13.512665 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-9d179a53-5538-4a58-b5ce-ea8d65c084d3 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001663 Jan 15 02:37:13.512665 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 33/67] 10.222.0.37 () {56 vars in 1065 bytes} [Fri Jan 15 02:37:13 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:37:13.724795 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-00fa7a9a-22ec-4747-b3c5-803c60c20207 admin admin] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:37:13.730844 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:37:13.730844 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: warnings.warn(msg) Jan 15 02:37:13.732450 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_concurrency.lockutils [None req-00fa7a9a-22ec-4747-b3c5-803c60c20207 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79427) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:37:13.732938 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_concurrency.lockutils [None req-00fa7a9a-22ec-4747-b3c5-803c60c20207 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=79427) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:37:13.733827 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_concurrency.lockutils [None req-00fa7a9a-22ec-4747-b3c5-803c60c20207 admin admin] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79427) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:37:13.734300 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_concurrency.lockutils [None req-00fa7a9a-22ec-4747-b3c5-803c60c20207 admin admin] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=79427) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:37:13.769819 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-00fa7a9a-22ec-4747-b3c5-803c60c20207 admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.134498 Jan 15 02:37:13.770693 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 35/68] 10.222.0.37 () {60 vars in 1184 bytes} [Fri Jan 15 02:37:13 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:37:15.354704 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-9d179a53-5538-4a58-b5ce-ea8d65c084d3 admin admin] Calling method '>' {{(pid=79428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:37:15.355763 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-9d179a53-5538-4a58-b5ce-ea8d65c084d3 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Jan 15 02:37:15.356191 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79428|app: 0|req: 34/69] 10.222.0.37 () {56 vars in 1065 bytes} [Fri Jan 15 02:37:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:37:15.573358 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG nova.api.openstack.wsgi [None req-0ec31adb-056e-48f1-abc7-26cc7de56358 admin admin] Calling method '>' {{(pid=79427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:37:15.579439 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:37:15.579439 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: warnings.warn(msg) Jan 15 02:37:15.581264 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_concurrency.lockutils [None req-0ec31adb-056e-48f1-abc7-26cc7de56358 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79427) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:37:15.581766 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_concurrency.lockutils [None req-0ec31adb-056e-48f1-abc7-26cc7de56358 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=79427) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:37:15.582627 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_concurrency.lockutils [None req-0ec31adb-056e-48f1-abc7-26cc7de56358 admin admin] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79427) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:37:15.583108 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: DEBUG oslo_concurrency.lockutils [None req-0ec31adb-056e-48f1-abc7-26cc7de56358 admin admin] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=79427) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:37:15.614022 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: INFO nova.api.openstack.requestlog [None req-0ec31adb-056e-48f1-abc7-26cc7de56358 admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.128919 Jan 15 02:37:15.614557 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: [pid: 79427|app: 0|req: 36/70] 10.222.0.37 () {60 vars in 1184 bytes} [Fri Jan 15 02:37:15 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:38:13.915479 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: Fri Jan 15 02:38:13 2021 - graceful shutdown triggered... Jan 15 02:38:13.915961 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: Gracefully killing worker 1 (pid: 79427)... Jan 15 02:38:13.916053 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: Gracefully killing worker 2 (pid: 79428)... Jan 15 02:38:13.917115 dv-cinder-763306-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 15 02:38:14.916635 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: worker 1 buried after 1 seconds Jan 15 02:38:14.916635 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: worker 2 buried after 1 seconds Jan 15 02:38:14.916635 dv-cinder-763306-8-iscsi devstack@n-api.service[79426]: goodbye to uWSGI. Jan 15 02:38:14.918337 dv-cinder-763306-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 15 02:38:14.920105 dv-cinder-763306-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 15 02:38:14.929112 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 15 02:38:14.931054 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: *** Starting uWSGI 2.0.15-debian (64bit) on [Fri Jan 15 02:38:14 2021] *** Jan 15 02:38:14.931054 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Jan 15 02:38:14.931054 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Jan 15 02:38:14.931054 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: nodename: dv-cinder-763306-8-iscsi Jan 15 02:38:14.931054 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: machine: x86_64 Jan 15 02:38:14.931054 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: clock source: unix Jan 15 02:38:14.931054 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: pcre jit disabled Jan 15 02:38:14.931054 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: detected number of CPU cores: 4 Jan 15 02:38:14.931054 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: current working directory: / Jan 15 02:38:14.931054 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: detected binary path: /usr/bin/uwsgi-core Jan 15 02:38:14.931054 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: dropping root privileges as early as possible Jan 15 02:38:14.931054 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: your processes number limit is 47843 Jan 15 02:38:14.931054 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: your memory page size is 4096 bytes Jan 15 02:38:14.932137 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: detected max file descriptor number: 2048 Jan 15 02:38:14.932137 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: lock engine: pthread robust mutexes Jan 15 02:38:14.932137 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: thunder lock: enabled Jan 15 02:38:14.932137 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 15 02:38:14.932137 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: dropping root privileges after socket binding Jan 15 02:38:14.932137 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: Python version: 3.6.9 (default, Oct 8 2020, 12:12:24) [GCC 8.4.0] Jan 15 02:38:14.977273 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: Python main interpreter initialized at 0x5617cf3029c0 Jan 15 02:38:14.977273 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: dropping root privileges after plugin initialization Jan 15 02:38:14.977273 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: python threads support enabled Jan 15 02:38:14.977273 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: your server socket listen backlog is limited to 100 connections Jan 15 02:38:14.977273 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: your mercy for graceful operations on workers is 90 seconds Jan 15 02:38:14.977871 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: mapped 402621 bytes (393 KB) for 2 cores Jan 15 02:38:14.977871 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: *** Operational MODE: preforking *** Jan 15 02:38:14.978050 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: dropping root privileges after application loading Jan 15 02:38:14.978050 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: *** uWSGI is running in multiple interpreter mode *** Jan 15 02:38:14.978050 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: spawned uWSGI master process (pid: 94109) Jan 15 02:38:14.978132 dv-cinder-763306-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 15 02:38:14.978426 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: spawned uWSGI worker 1 (pid: 94111, cores: 1) Jan 15 02:38:14.978755 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: spawned uWSGI worker 2 (pid: 94112, cores: 1) Jan 15 02:38:14.978862 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 15 02:38:20.532008 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Jan 15 02:38:20.533184 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Jan 15 02:38:20.536002 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Jan 15 02:38:20.536713 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Jan 15 02:38:20.537254 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Jan 15 02:38:20.537982 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.538512 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.539342 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.539939 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.540539 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.541108 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.541697 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.542301 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.542935 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.543435 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.544058 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.544699 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-763306-8-iscsi {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.545337 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.546192 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.546798 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.547430 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.548075 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.548671 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.549286 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.550460 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.551071 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.551673 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.552279 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.552936 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.553592 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.554206 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.554839 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.555451 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.556090 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.556700 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.557368 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-763306-8-iscsi {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.557993 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.558591 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.559206 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.560068 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.560671 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.561305 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.561929 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.562557 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.563155 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.563820 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.564442 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.565096 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.565741 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.566339 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.566943 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.567590 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.568175 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.568775 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.569431 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.569910 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.570719 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.571347 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.571973 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.572660 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.573193 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.573698 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.574323 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.574962 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.575564 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.576170 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.576766 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.577391 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.577999 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.578594 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.579655 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Jan 15 02:38:20.580055 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.580170 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Jan 15 02:38:20.580271 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.580858 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.581517 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.582147 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.582723 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.583354 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.583551 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Jan 15 02:38:20.584153 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Jan 15 02:38:20.584327 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.584621 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.584772 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Jan 15 02:38:20.585246 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.585429 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.585929 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.586052 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.586525 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.586646 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.587115 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.587229 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.587731 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.587881 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.588311 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.588446 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.588903 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.589050 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.589537 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.591578 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.591699 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.591784 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.591868 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.591945 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.592023 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.592095 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.592173 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.592379 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.592724 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-763306-8-iscsi {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.592971 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.593429 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.593626 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.594024 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.594182 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.594625 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.594783 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.595851 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.596008 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.596899 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.597283 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.597283 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.597495 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.597788 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.597958 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.598389 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.598985 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.599175 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.599560 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.599772 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.600174 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.600774 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.600883 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.601413 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.601591 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.602001 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.602168 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.602588 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.602713 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.603180 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.603297 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.603771 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.603944 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.604379 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.604531 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.604965 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.605142 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.605582 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.605741 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-763306-8-iscsi {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.606168 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.606334 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.606759 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.606959 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.607390 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.607975 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.608236 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.608577 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.609273 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.609452 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.609711 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.609880 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.610394 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.610587 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.610967 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.611192 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.611591 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.611761 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.612192 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.612356 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.612827 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.613135 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.613481 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.613644 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.614069 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.614231 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.614685 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.614817 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.615263 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.615359 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.615845 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.615958 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.616424 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.616539 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.617042 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.617160 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.617631 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.618221 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.618537 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.619180 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.619302 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.619408 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.619708 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.619904 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.620308 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.620501 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.620899 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.621099 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.621544 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.621664 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.622033 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.622166 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.622643 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.622733 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.623258 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.623480 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.623880 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.624484 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.624683 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.625196 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.626001 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.626205 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.626824 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.627250 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.627445 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.628099 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.628464 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.628774 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.629443 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.629784 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.630075 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.630702 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.631008 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.631368 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.631991 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.632243 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.632623 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.633231 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.633426 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.633880 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.634464 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.634649 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.635146 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.635687 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.635885 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.636365 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.636895 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.637115 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.637633 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.638162 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.638292 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.638796 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.638908 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.639566 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.639681 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.640017 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.640127 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.640614 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.640733 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.641308 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.641436 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.642460 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.642639 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.643036 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.643223 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.643827 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.643952 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.644274 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.644376 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.644895 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.645020 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.645992 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.646389 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.647029 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.647687 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.647929 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.648251 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.648546 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.648720 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.649399 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.649520 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.649783 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.649882 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.650443 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.650621 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.651028 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.651213 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.651612 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.651819 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.652188 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.652362 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.652763 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.652945 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.653397 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.654008 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.654184 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.654617 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.654792 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.655218 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.655385 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.655808 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.655972 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.656396 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.656563 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.656979 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.657178 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.658212 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.658628 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.658807 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.659229 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.659391 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.659858 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.660035 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.660451 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.660627 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.661060 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.661240 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.661654 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.661821 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.662221 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.662390 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.662809 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.662973 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.663432 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.663605 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.663950 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.664158 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.664531 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.664747 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.665155 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.665328 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.665711 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.665880 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.666281 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.666470 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.666862 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.667082 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.667466 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.667644 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.668027 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.668222 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.668600 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.668825 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.669687 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.670184 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.670813 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.670988 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.671394 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.671627 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.671993 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.672172 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.672569 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.672868 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.673264 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.673971 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.674147 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.674456 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.674647 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.675251 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.675434 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.675593 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.675751 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.676159 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.676335 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.676826 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.677091 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.677589 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.677763 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.677913 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.678061 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.678494 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.678780 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.679159 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.679466 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.679643 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.679795 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.680592 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.680772 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.680772 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.681139 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Jan 15 02:38:20.681402 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.681972 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.682706 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.683240 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.684185 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.684368 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.684628 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.684787 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.684950 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.685149 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.685511 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.685679 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.686307 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.686467 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.686765 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.687020 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.687367 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.687536 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.687980 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.688145 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.689347 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.689663 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.689899 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.690096 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.690375 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.690692 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.690982 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.691331 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.691585 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.692647 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.692834 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.692986 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.693199 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.693349 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.693502 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.693737 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.693901 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.694356 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.694532 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.694992 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.695154 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.695618 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.695791 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.696590 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.696857 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.696857 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.697323 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.697486 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.697634 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.697950 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.698106 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.698569 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.698727 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.699157 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.699608 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.699776 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.699925 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.700314 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.700491 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.700913 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.701115 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.701645 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.702197 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.702821 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.703348 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.703523 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.703922 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.704121 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.705065 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.707369 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.707546 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.707694 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.707843 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.707980 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.708117 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.708117 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.708391 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.708535 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.708535 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.708784 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.708929 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.708929 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.709256 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.709389 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.709534 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.709669 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.709669 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.709934 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.710078 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.710078 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.710343 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.710487 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.710629 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.710774 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.710918 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.711820 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.712011 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.712190 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.712359 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.712541 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.712541 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.712868 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.713073 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.713073 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.713388 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.713728 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.714072 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.714265 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.714443 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.714696 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.714884 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.715074 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.715340 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.715477 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.715752 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.715871 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.716116 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.716345 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.716791 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.716973 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.717345 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.717512 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.717682 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.717973 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.718136 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.718331 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.718684 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.718855 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.719015 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.719307 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.719471 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.719693 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.719939 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.720102 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.720425 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.720909 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.721371 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.721572 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.721738 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.721991 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.722217 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.722377 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.722629 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.722872 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.723117 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.723337 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.723544 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.723703 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.724064 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.724299 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.724517 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.724746 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.724987 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.725238 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.725541 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.725700 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.725850 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.726108 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.726398 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.726562 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.726772 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.726939 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.727096 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.727557 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.727736 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.727894 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.728162 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.728647 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.728882 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.729073 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.729237 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.729514 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.729673 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.729871 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.730220 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.730390 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.730596 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.730850 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.731112 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.731584 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.731756 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.731916 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.731916 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.732320 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.732476 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.732630 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.732800 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.732951 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.733230 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.733393 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.733700 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.733886 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.734046 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.734377 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.734534 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.734754 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.735011 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.735177 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.735614 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.735796 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.736083 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.736241 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.736406 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.736762 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.736935 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.737443 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.737618 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.737982 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.738142 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.738306 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.739134 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.739311 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.739311 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.739616 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.739787 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.739787 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.740078 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.740227 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.740381 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.740535 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.740692 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.740930 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.741141 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.741399 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.742004 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.742202 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.742202 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.742597 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.742745 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.742745 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.743033 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.743187 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.743450 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.743606 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.743754 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.744005 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.744162 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.744361 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.744624 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.744793 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.745060 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.745308 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.745465 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.745819 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.745984 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.746139 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.746403 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.746561 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.746829 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.747072 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.747229 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.747565 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.747782 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.748031 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.748186 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.748343 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.748490 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.749314 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.749499 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.749652 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.749652 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.749943 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.750098 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.750270 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.750421 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.750575 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.750822 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.750992 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.751846 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.752219 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.752384 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.752642 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.752809 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.752965 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.753143 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.753495 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.753670 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.753825 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.754122 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.754279 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.754471 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.754745 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.754901 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.755162 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.755327 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.755517 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.755961 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.756127 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.756275 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.756713 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.757041 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.757041 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.757344 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.757612 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.757955 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.758222 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.758397 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.758626 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.758782 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.758983 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.759282 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.759477 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.759631 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.759987 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.760160 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.760317 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.760668 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.760846 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.761059 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.761352 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.761521 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.762007 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.762409 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.762587 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.762587 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.762993 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.763142 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.763142 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.763432 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.763689 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.763689 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.763986 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.764134 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.764363 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.764529 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.764873 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.765082 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.765245 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.765582 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.765746 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.765903 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.766253 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.766413 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.766608 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.767605 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.767779 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.768121 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.768303 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.768556 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.768717 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.769415 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.769775 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.770153 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.770454 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.770628 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.771094 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.771330 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.771487 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.771803 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.771959 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.772162 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.772531 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.772686 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.772897 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.773252 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.773425 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.773624 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.773885 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.774103 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.774949 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.775169 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.775363 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.775562 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.775753 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.775954 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.776155 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.776352 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.776586 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.776899 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.777293 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.777293 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.777662 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.778247 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.778443 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.778621 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.778793 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.779069 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.779244 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.779423 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.779757 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.779946 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.780124 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.780412 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.780596 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.780773 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.781174 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.781529 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.781905 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.782306 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.782690 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.782993 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.783201 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.783552 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.783761 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.783966 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.784197 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.784383 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.784561 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.784902 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.785130 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.785300 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.785607 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.785869 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.786049 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.786215 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.786402 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.786643 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.786864 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.787040 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.787275 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.787504 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.787692 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.787961 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.788137 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.788305 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.788646 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.788859 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.789075 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.789340 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.789714 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.790036 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.790230 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.790481 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.790732 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.791105 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.791271 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.791477 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.791829 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.791995 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.792203 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.792503 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.792669 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.792878 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.793261 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.793434 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.793637 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.794190 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.794352 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.794503 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.794651 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.794810 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.794998 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.795239 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.795411 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.795708 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.795933 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.796102 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.796825 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.796958 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.797206 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.797296 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.797410 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.797514 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.798090 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.798372 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.798523 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.798838 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.799178 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.799526 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.799882 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.800617 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.800759 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.800759 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.800986 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.801150 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.801263 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.801416 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.801773 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.801970 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.802150 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.802492 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.802615 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.802833 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.803115 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.803245 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.803501 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.804598 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.804742 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.804742 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.804963 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.805128 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.805128 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.805345 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.805463 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.805575 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.805692 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.805954 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.806139 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.806327 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.806899 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.807038 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.807156 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.807364 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.807489 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.807719 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.807982 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.808103 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.808450 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.808593 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.808714 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.809107 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.809289 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.809406 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.809764 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.809895 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.810127 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.810468 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.810768 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.811273 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.811421 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.811538 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.811657 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.811823 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.812177 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.812299 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.812524 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.812884 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.813049 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.813262 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.814035 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.814315 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.814998 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.815132 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.815248 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.815366 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.815490 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.815754 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.816068 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.816202 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.816479 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.816697 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.816873 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.817377 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.817967 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.818160 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.818450 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.818689 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.818815 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.819145 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.819354 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.819556 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.819776 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.819911 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.820391 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.820531 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.820651 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.820862 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.820992 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.821307 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.821527 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.821650 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.822003 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.822185 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.822363 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.822725 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.822859 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.823086 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.823636 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.823783 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.823783 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.824014 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.824128 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.824723 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.825164 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.825310 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.825433 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.825690 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.825871 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.826055 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.826311 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.826439 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.826752 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.826887 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.827364 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.827503 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.827728 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.828114 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.828406 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.828681 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.828932 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.829908 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.829908 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.830211 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.830379 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.830516 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.830687 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.830865 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.831094 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.831264 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.831459 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.831696 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.831874 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.832100 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.832212 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.832464 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.832726 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.832910 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.833167 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.833535 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.833890 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.834509 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.834910 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.835529 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.835676 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.835791 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.835974 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.836096 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.836335 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.836602 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.836717 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.837075 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.837245 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.837509 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.837731 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.837889 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.838098 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.838363 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.838526 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.838775 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.839038 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.839198 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.839450 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.839614 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.839769 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.840121 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.840285 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.840451 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.840821 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.841180 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.841180 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.841488 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.841663 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.841966 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.842146 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.842304 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.842518 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.842670 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.842824 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.843158 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.843327 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.843476 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.843824 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.843982 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.844179 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.844527 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.845501 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.845830 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.846009 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.846169 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.846169 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.846459 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.846611 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.846611 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.846927 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.847137 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.847298 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.847452 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.847452 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.847855 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.848243 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.848402 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.848745 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.848910 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.849211 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.849373 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.849521 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.849827 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.849990 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.850153 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.850556 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.850817 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.850981 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.851140 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.851528 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.851784 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.851953 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.852253 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.852410 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.852653 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.853053 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.853236 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.853386 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.853672 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.853830 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.854062 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.854287 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.854457 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.854758 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.854922 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.855113 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.855502 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.855682 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.855859 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.856119 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.856283 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.856434 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.856769 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.856936 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.857121 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.857471 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.857628 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.857878 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.858143 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.858317 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.858527 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.858793 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.858949 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.859313 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.859492 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.859650 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.859905 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.860069 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.860259 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.860642 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.860829 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.861102 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.861471 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.861636 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.861791 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.862096 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.862266 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.862415 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.862733 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.862904 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.863223 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.863386 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.863585 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.863951 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.864116 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.864307 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.864638 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.864811 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.865085 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.865248 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.865629 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.865798 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.865967 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.866143 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.866401 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.866555 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.866820 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.867050 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.867405 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.867576 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.867797 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.868058 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.868221 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.868524 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.868697 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.868905 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.869218 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.869411 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.869638 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.869825 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.869999 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.870262 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.870440 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.870652 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.870826 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.871016 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.871333 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.871864 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.871864 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.872208 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.872383 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.872556 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.872735 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.872905 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.873102 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.873434 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.873638 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.873904 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.874101 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.874342 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.874628 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.874811 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.875027 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.875263 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.875453 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.875738 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.875907 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.876637 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.876996 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.877219 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.877388 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.877635 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.877814 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.878057 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.878438 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.878760 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.878942 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.879110 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.879387 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.879584 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.879801 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.879989 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.880172 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.880453 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.880631 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.880801 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.881178 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.881379 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.881592 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.882056 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.882241 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.882241 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.882589 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.882767 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.882950 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.883119 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.883297 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.883560 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.883754 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.883933 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.884236 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.884413 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.884579 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.884839 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.885058 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.885289 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.885549 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.885724 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.885927 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.886183 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.886315 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.886616 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.886760 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.886997 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.887360 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.887551 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.887729 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.887983 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.888171 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.888445 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.888656 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.888921 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.889256 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.889444 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.889624 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.889892 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94111) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Jan 15 02:38:20.890069 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.890505 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.891000 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.891496 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.892672 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.893195 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.893694 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.894170 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.894647 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.895149 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.895648 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.896461 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.896957 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.897482 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.898116 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.898529 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.898995 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.899475 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.900075 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.900629 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.901232 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.901731 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.902231 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.902852 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.903343 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.903814 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.904295 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.904763 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.905364 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.906002 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.906704 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.907112 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.907664 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.908167 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.908586 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.909055 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.909478 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.909891 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.910327 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.910829 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.911269 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.911703 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.912146 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.912592 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.913196 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.913722 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.914202 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.914679 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.915279 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.915824 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.916465 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.917186 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.917835 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.918279 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.918886 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.919538 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.920176 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.920777 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.921387 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.921828 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.922352 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.922837 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.923502 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.924078 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.924617 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.925111 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.925548 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.926075 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.926512 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.927043 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.927484 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.928012 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.928534 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.929141 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.929740 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.930358 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.931071 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.931576 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.932102 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.932733 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.933301 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.933597 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_db.sqlalchemy.engines [None req-ec6718db-f81c-41ed-8a79-88ac8fcd4b22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94111) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jan 15 02:38:20.933960 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.934458 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.934984 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.935764 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.936158 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.936740 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.937715 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.938014 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.938527 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.939564 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.940080 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.940596 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.941297 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.941794 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.942846 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.943324 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.944257 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.944566 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.945230 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.945810 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.946420 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.946914 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.947427 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.947931 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.948434 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.948935 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.949481 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.950018 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.950562 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.951115 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.951808 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.952325 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.952844 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.953460 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.954248 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.955354 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.956089 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.956687 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.957411 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.957913 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.958508 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.959392 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.959675 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.960195 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.960788 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.961646 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.962053 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.962531 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.963110 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.963739 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.964395 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.964916 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.965493 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.966018 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.966855 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.967373 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.968017 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.968570 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.969089 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.969610 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.970208 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.970738 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.971239 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.971744 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.972276 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.972787 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.973330 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.973896 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.974521 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.975028 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.975547 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.976063 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.976839 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.977424 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.977946 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.978472 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.979022 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.979551 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.980080 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.980616 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.981161 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.981668 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.982260 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.982750 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.983219 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.983716 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.984187 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.984737 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.985259 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.985927 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.986403 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.986907 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.987378 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.987856 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.988332 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.988817 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.989335 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.989803 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.990274 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.990740 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.991265 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.991738 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.992298 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.992753 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.993247 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.993682 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.994132 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.994559 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.995063 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.995493 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.995922 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.996366 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.996809 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.997295 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.997742 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.998211 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.998689 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.999146 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:20.999878 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.000414 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.001758 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.002244 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.002820 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.003286 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.003725 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.004158 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.004605 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.005143 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.005582 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.006025 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.006456 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.006950 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.007384 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.007815 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.008277 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.008715 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.009192 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.009657 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.010106 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.010544 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.010983 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.011425 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.011862 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.012294 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.012846 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.013321 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.013817 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.014277 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.014722 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.015215 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.015795 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.016228 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.017390 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.017897 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.018295 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.018734 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.019153 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.019561 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.019953 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.020317 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.020678 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.021320 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.021689 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.022098 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.022499 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.022873 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.023255 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.023642 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.024011 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.024377 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.024740 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.025131 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.025491 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.025867 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.026237 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.026607 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.026968 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.027344 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.027707 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.028078 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.028440 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.028801 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.029189 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.029557 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.029945 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.030309 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.030687 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.031046 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.031423 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.031783 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.032159 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.032538 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.032903 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.033285 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.033670 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.034027 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.034389 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.034744 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.035102 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.035459 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.035812 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.036191 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.036568 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.036920 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.037322 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.037690 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.038057 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.038420 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.038779 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.039160 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.039514 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.039877 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.040230 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.040585 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.040947 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.041343 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.041716 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.042345 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.042474 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.042786 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.043185 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.043547 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.043938 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.044321 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Jan 15 02:38:21.044605 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94112) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Jan 15 02:38:21.081815 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_db.sqlalchemy.engines [None req-386e6cf3-c0fa-4331-bd34-523ee6d0b35d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94112) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jan 15 02:38:21.203493 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.context [None req-ec6718db-f81c-41ed-8a79-88ac8fcd4b22 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),970f11a0-4ab6-42a9-9f4d-116f76c8b008(cell1) {{(pid=94111) load_cells /opt/stack/nova/nova/context.py:466}} Jan 15 02:38:21.209950 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ec6718db-f81c-41ed-8a79-88ac8fcd4b22 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:38:21.211800 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ec6718db-f81c-41ed-8a79-88ac8fcd4b22 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:38:21.212683 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ec6718db-f81c-41ed-8a79-88ac8fcd4b22 None None] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:38:21.214839 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ec6718db-f81c-41ed-8a79-88ac8fcd4b22 None None] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:38:21.241355 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_db.sqlalchemy.engines [None req-ec6718db-f81c-41ed-8a79-88ac8fcd4b22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94111) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jan 15 02:38:21.242262 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_db.sqlalchemy.engines [None req-ec6718db-f81c-41ed-8a79-88ac8fcd4b22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94111) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jan 15 02:38:21.273155 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_db.sqlalchemy.engines [None req-ec6718db-f81c-41ed-8a79-88ac8fcd4b22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94111) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jan 15 02:38:21.349584 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.context [None req-386e6cf3-c0fa-4331-bd34-523ee6d0b35d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),970f11a0-4ab6-42a9-9f4d-116f76c8b008(cell1) {{(pid=94112) load_cells /opt/stack/nova/nova/context.py:466}} Jan 15 02:38:21.355085 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-386e6cf3-c0fa-4331-bd34-523ee6d0b35d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:38:21.356929 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-386e6cf3-c0fa-4331-bd34-523ee6d0b35d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:38:21.357832 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-386e6cf3-c0fa-4331-bd34-523ee6d0b35d None None] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:38:21.360222 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-386e6cf3-c0fa-4331-bd34-523ee6d0b35d None None] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:38:21.382553 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_db.sqlalchemy.engines [None req-386e6cf3-c0fa-4331-bd34-523ee6d0b35d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94112) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jan 15 02:38:21.391393 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_db.sqlalchemy.engines [None req-386e6cf3-c0fa-4331-bd34-523ee6d0b35d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94112) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jan 15 02:38:21.418706 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_db.sqlalchemy.engines [None req-386e6cf3-c0fa-4331-bd34-523ee6d0b35d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94112) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jan 15 02:38:21.442998 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO keyring.backend [None req-ec6718db-f81c-41ed-8a79-88ac8fcd4b22 None None] Loading Gnome Jan 15 02:38:21.465445 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO keyring.backend [None req-ec6718db-f81c-41ed-8a79-88ac8fcd4b22 None None] Loading Google Jan 15 02:38:21.469114 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO keyring.backend [None req-ec6718db-f81c-41ed-8a79-88ac8fcd4b22 None None] Loading Windows (alt) Jan 15 02:38:21.474027 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO keyring.backend [None req-ec6718db-f81c-41ed-8a79-88ac8fcd4b22 None None] Loading file Jan 15 02:38:21.475142 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO keyring.backend [None req-ec6718db-f81c-41ed-8a79-88ac8fcd4b22 None None] Loading keyczar Jan 15 02:38:21.475597 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO keyring.backend [None req-ec6718db-f81c-41ed-8a79-88ac8fcd4b22 None None] Loading multi Jan 15 02:38:21.476968 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO keyring.backend [None req-ec6718db-f81c-41ed-8a79-88ac8fcd4b22 None None] Loading pyfs Jan 15 02:38:21.584072 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO keyring.backend [None req-386e6cf3-c0fa-4331-bd34-523ee6d0b35d None None] Loading Gnome Jan 15 02:38:21.607149 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO keyring.backend [None req-386e6cf3-c0fa-4331-bd34-523ee6d0b35d None None] Loading Google Jan 15 02:38:21.611335 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO keyring.backend [None req-386e6cf3-c0fa-4331-bd34-523ee6d0b35d None None] Loading Windows (alt) Jan 15 02:38:21.616089 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO keyring.backend [None req-386e6cf3-c0fa-4331-bd34-523ee6d0b35d None None] Loading file Jan 15 02:38:21.617249 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO keyring.backend [None req-386e6cf3-c0fa-4331-bd34-523ee6d0b35d None None] Loading keyczar Jan 15 02:38:21.617713 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO keyring.backend [None req-386e6cf3-c0fa-4331-bd34-523ee6d0b35d None None] Loading multi Jan 15 02:38:21.618587 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO keyring.backend [None req-386e6cf3-c0fa-4331-bd34-523ee6d0b35d None None] Loading pyfs Jan 15 02:38:21.790470 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: WARNING keystonemiddleware.auth_token [None req-ec6718db-f81c-41ed-8a79-88ac8fcd4b22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 15 02:38:21.799675 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: WARNING keystonemiddleware.auth_token [None req-ec6718db-f81c-41ed-8a79-88ac8fcd4b22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 15 02:38:21.914386 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: WARNING keystonemiddleware.auth_token [None req-386e6cf3-c0fa-4331-bd34-523ee6d0b35d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 15 02:38:21.922759 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: WARNING keystonemiddleware.auth_token [None req-386e6cf3-c0fa-4331-bd34-523ee6d0b35d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 15 02:38:22.140135 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: WARNING keystonemiddleware.auth_token [None req-ec6718db-f81c-41ed-8a79-88ac8fcd4b22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 15 02:38:22.146832 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: WARNING keystonemiddleware.auth_token [None req-ec6718db-f81c-41ed-8a79-88ac8fcd4b22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 15 02:38:22.152441 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x5617cf3029c0 pid: 94111 (default app) Jan 15 02:38:22.257599 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: WARNING keystonemiddleware.auth_token [None req-386e6cf3-c0fa-4331-bd34-523ee6d0b35d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 15 02:38:22.263281 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: WARNING keystonemiddleware.auth_token [None req-386e6cf3-c0fa-4331-bd34-523ee6d0b35d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 15 02:38:22.269659 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x5617cf3029c0 pid: 94112 (default app) Jan 15 02:39:02.446885 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-142276a8-e1c8-44e8-badc-bb977e4fec8f tempest-VolumesGetTestJSON-860278273 tempest-VolumesGetTestJSON-860278273] Action: 'create', calling method: .version_select at 0x7f879040b048>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-732511880", "metadata": {"Type": "work"}}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:39:04.191109 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-142276a8-e1c8-44e8-badc-bb977e4fec8f tempest-VolumesGetTestJSON-860278273 tempest-VolumesGetTestJSON-860278273] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.495975 Jan 15 02:39:04.193469 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 1/1] 10.222.0.37 () {60 vars in 1146 bytes} [Fri Jan 15 02:39:00 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 3500 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 15 02:39:04.211898 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6a5c6a1e-ed87-43cc-b34f-94dff973325a tempest-VolumesGetTestJSON-860278273 tempest-VolumesGetTestJSON-860278273] Calling method '.version_select at 0x7f879040b840>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:04.304481 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ba27ecb7-d9b9-426d-8295-6926c274dd3d tempest-VolumesTestJSON-619646775 tempest-VolumesTestJSON-619646775] Calling method '.version_select at 0x7f87905ffb70>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:04.501794 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6a5c6a1e-ed87-43cc-b34f-94dff973325a tempest-VolumesGetTestJSON-860278273 tempest-VolumesGetTestJSON-860278273] 10.222.0.37 "GET /compute/v2.1/os-volumes/e71f4997-7f3f-40dd-ab35-60fa1cef18b3" status: 200 len: 352 microversion: 2.1 time: 0.300472 Jan 15 02:39:04.502359 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 2/2] 10.222.0.37 () {58 vars in 1235 bytes} [Fri Jan 15 02:39:04 2021] GET /compute/v2.1/os-volumes/e71f4997-7f3f-40dd-ab35-60fa1cef18b3 => generated 352 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:39:05.521565 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-46c44e84-05c3-4eae-85ec-b3e4c3f0e60e tempest-VolumesGetTestJSON-860278273 tempest-VolumesGetTestJSON-860278273] Calling method '.version_select at 0x7f87904ae8c8>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:05.830248 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ba27ecb7-d9b9-426d-8295-6926c274dd3d tempest-VolumesTestJSON-619646775 tempest-VolumesTestJSON-619646775] 10.222.0.37 "GET /compute/v2.1/os-volumes/2aee5b19-dc32-4272-a23a-dba9fcafaccf" status: 200 len: 350 microversion: 2.1 time: 2.360797 Jan 15 02:39:05.830248 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 1/3] 10.222.0.37 () {58 vars in 1235 bytes} [Fri Jan 15 02:39:03 2021] GET /compute/v2.1/os-volumes/2aee5b19-dc32-4272-a23a-dba9fcafaccf => generated 350 bytes in 2364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:39:05.954583 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-46c44e84-05c3-4eae-85ec-b3e4c3f0e60e tempest-VolumesGetTestJSON-860278273 tempest-VolumesGetTestJSON-860278273] 10.222.0.37 "GET /compute/v2.1/os-volumes/e71f4997-7f3f-40dd-ab35-60fa1cef18b3" status: 200 len: 353 microversion: 2.1 time: 0.443208 Jan 15 02:39:05.955671 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 3/4] 10.222.0.37 () {58 vars in 1235 bytes} [Fri Jan 15 02:39:05 2021] GET /compute/v2.1/os-volumes/e71f4997-7f3f-40dd-ab35-60fa1cef18b3 => generated 353 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:39:05.987960 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e3a36553-7939-4b97-be3f-408acfb226e0 tempest-VolumesGetTestJSON-860278273 tempest-VolumesGetTestJSON-860278273] Calling method '.version_select at 0x7f8790582158>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:06.817040 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ffc01848-d844-477a-87b4-b3c6e0519a33 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-252815436", "imageRef": "1807a1cb-835d-4a56-8751-82ffa40b12c9", "flavorRef": "452", "networks": [{"uuid": "e843fac3-474a-4130-8a40-a60c76e407e2"}]}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:39:07.219219 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-ffc01848-d844-477a-87b4-b3c6e0519a33 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] validate_networks() for [('e843fac3-474a-4130-8a40-a60c76e407e2', None, None, None)] {{(pid=94111) validate_networks /opt/stack/nova/nova/network/neutron.py:2340}} Jan 15 02:39:07.312491 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e3a36553-7939-4b97-be3f-408acfb226e0 tempest-VolumesGetTestJSON-860278273 tempest-VolumesGetTestJSON-860278273] 10.222.0.37 "GET /compute/v2.1/os-volumes/e71f4997-7f3f-40dd-ab35-60fa1cef18b3" status: 200 len: 353 microversion: 2.1 time: 1.348775 Jan 15 02:39:07.313438 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 2/5] 10.222.0.37 () {58 vars in 1235 bytes} [Fri Jan 15 02:39:05 2021] GET /compute/v2.1/os-volumes/e71f4997-7f3f-40dd-ab35-60fa1cef18b3 => generated 353 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:39:07.349379 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b2db6468-11c8-41f4-8ade-e83b324714a2 tempest-VolumesGetTestJSON-860278273 tempest-VolumesGetTestJSON-860278273] Calling method '.version_select at 0x7f879053ba60>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:07.923875 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b2db6468-11c8-41f4-8ade-e83b324714a2 tempest-VolumesGetTestJSON-860278273 tempest-VolumesGetTestJSON-860278273] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/e71f4997-7f3f-40dd-ab35-60fa1cef18b3" status: 202 len: 0 microversion: 2.1 time: 0.591380 Jan 15 02:39:07.925818 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 3/6] 10.222.0.37 () {58 vars in 1238 bytes} [Fri Jan 15 02:39:07 2021] DELETE /compute/v2.1/os-volumes/e71f4997-7f3f-40dd-ab35-60fa1cef18b3 => generated 0 bytes in 594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 02:39:07.951661 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ef933a24-a4d3-47f8-8689-eaa1e531d845 tempest-VolumesGetTestJSON-860278273 tempest-VolumesGetTestJSON-860278273] Calling method '.version_select at 0x7f8790582158>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:08.279273 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ef933a24-a4d3-47f8-8689-eaa1e531d845 tempest-VolumesGetTestJSON-860278273 tempest-VolumesGetTestJSON-860278273] 10.222.0.37 "GET /compute/v2.1/os-volumes/e71f4997-7f3f-40dd-ab35-60fa1cef18b3" status: 200 len: 352 microversion: 2.1 time: 0.348363 Jan 15 02:39:08.280879 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 4/7] 10.222.0.37 () {58 vars in 1235 bytes} [Fri Jan 15 02:39:07 2021] GET /compute/v2.1/os-volumes/e71f4997-7f3f-40dd-ab35-60fa1cef18b3 => generated 352 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:39:08.622132 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c09b3648-aa45-4e65-a7a0-9fc0411e7dab tempest-VolumesTestJSON-619646775 tempest-VolumesTestJSON-619646775] Calling method '.version_select at 0x7f879053b378>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:08.835766 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c09b3648-aa45-4e65-a7a0-9fc0411e7dab tempest-VolumesTestJSON-619646775 tempest-VolumesTestJSON-619646775] 10.222.0.37 "GET /compute/v2.1/os-volumes/d3e90c55-2beb-4560-97ca-1c4c8ded6894" status: 200 len: 351 microversion: 2.1 time: 0.228882 Jan 15 02:39:08.836366 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 5/8] 10.222.0.37 () {58 vars in 1235 bytes} [Fri Jan 15 02:39:08 2021] GET /compute/v2.1/os-volumes/d3e90c55-2beb-4560-97ca-1c4c8ded6894 => generated 351 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:39:09.228639 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-ffc01848-d844-477a-87b4-b3c6e0519a33 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Flavor limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 02:39:09.229459 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-ffc01848-d844-477a-87b4-b3c6e0519a33 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Image limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Jan 15 02:39:09.229791 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-ffc01848-d844-477a-87b4-b3c6e0519a33 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Flavor pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 02:39:09.230045 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-ffc01848-d844-477a-87b4-b3c6e0519a33 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Image pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Jan 15 02:39:09.230733 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-ffc01848-d844-477a-87b4-b3c6e0519a33 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Jan 15 02:39:09.262194 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ffc01848-d844-477a-87b4-b3c6e0519a33 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:09.263027 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ffc01848-d844-477a-87b4-b3c6e0519a33 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:09.264109 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ffc01848-d844-477a-87b4-b3c6e0519a33 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:09.266345 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ffc01848-d844-477a-87b4-b3c6e0519a33 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:09.302556 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c9ccf1c1-d1f3-4a2f-9528-2ced5aabb102 tempest-VolumesGetTestJSON-860278273 tempest-VolumesGetTestJSON-860278273] Calling method '.version_select at 0x7f879053be18>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:09.316479 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-ffc01848-d844-477a-87b4-b3c6e0519a33 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Getting quotas for project 026ea5b3764f4a068aadc567e576c3a0. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:39:09.331555 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-ffc01848-d844-477a-87b4-b3c6e0519a33 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Getting quotas for user 6681e7cd24a94e4b99434f9c3c04a879 and project 026ea5b3764f4a068aadc567e576c3a0. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:39:09.353155 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ffc01848-d844-477a-87b4-b3c6e0519a33 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Going to run 1 instances... {{(pid=94111) _provision_instances /opt/stack/nova/nova/compute/api.py:1263}} Jan 15 02:39:09.357965 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ffc01848-d844-477a-87b4-b3c6e0519a33 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1807a1cb-835d-4a56-8751-82ffa40b12c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1661}} Jan 15 02:39:09.574445 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ffc01848-d844-477a-87b4-b3c6e0519a33 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.048912 Jan 15 02:39:09.575537 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 4/9] 10.222.0.37 () {60 vars in 1137 bytes} [Fri Jan 15 02:39:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 3051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 02:39:09.606479 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3a5b6cb5-c3d5-476c-a75f-78086f958fbc tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:09.614242 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3a5b6cb5-c3d5-476c-a75f-78086f958fbc tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:09.858202 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-c9ccf1c1-d1f3-4a2f-9528-2ced5aabb102 tempest-VolumesGetTestJSON-860278273 tempest-VolumesGetTestJSON-860278273] HTTP exception thrown: Volume e71f4997-7f3f-40dd-ab35-60fa1cef18b3 could not be found. Jan 15 02:39:09.859891 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c9ccf1c1-d1f3-4a2f-9528-2ced5aabb102 tempest-VolumesGetTestJSON-860278273 tempest-VolumesGetTestJSON-860278273] Returning 404 to user: Volume e71f4997-7f3f-40dd-ab35-60fa1cef18b3 could not be found. {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:39:09.861728 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c9ccf1c1-d1f3-4a2f-9528-2ced5aabb102 tempest-VolumesGetTestJSON-860278273 tempest-VolumesGetTestJSON-860278273] 10.222.0.37 "GET /compute/v2.1/os-volumes/e71f4997-7f3f-40dd-ab35-60fa1cef18b3" status: 404 len: 109 microversion: 2.1 time: 0.570738 Jan 15 02:39:09.862230 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 6/10] 10.222.0.37 () {58 vars in 1235 bytes} [Fri Jan 15 02:39:09 2021] GET /compute/v2.1/os-volumes/e71f4997-7f3f-40dd-ab35-60fa1cef18b3 => generated 109 bytes in 572 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:39:09.882806 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3a5b6cb5-c3d5-476c-a75f-78086f958fbc tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6681e7cd24a94e4b99434f9c3c04a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea5b3764f4a068aadc567e576c3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:09.924270 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3a5b6cb5-c3d5-476c-a75f-78086f958fbc tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 200 len: 1214 microversion: 2.1 time: 0.325610 Jan 15 02:39:09.930523 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 5/11] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:09 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 1214 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:39:10.285944 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-357742fa-b611-4ef9-b2c7-b3099a1fb85e tempest-VolumesTestJSON-619646775 tempest-VolumesTestJSON-619646775] Calling method '.version_select at 0x7f879053b8c8>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:10.667123 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-357742fa-b611-4ef9-b2c7-b3099a1fb85e tempest-VolumesTestJSON-619646775 tempest-VolumesTestJSON-619646775] 10.222.0.37 "GET /compute/v2.1/os-volumes/9e6e67cd-b31e-46d9-b85e-32fce7785d8b" status: 200 len: 351 microversion: 2.1 time: 0.392081 Jan 15 02:39:10.668500 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 7/12] 10.222.0.37 () {58 vars in 1235 bytes} [Fri Jan 15 02:39:10 2021] GET /compute/v2.1/os-volumes/9e6e67cd-b31e-46d9-b85e-32fce7785d8b => generated 351 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:39:10.693904 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-238838ee-143f-4708-af63-1d49693d24d5 tempest-VolumesTestJSON-619646775 tempest-VolumesTestJSON-619646775] Calling method '.version_select at 0x7f879037d400>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:10.970413 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c8df1fc7-b34e-4647-b431-aa3f90157a6b tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:10.971799 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c8df1fc7-b34e-4647-b431-aa3f90157a6b tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:11.123109 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-238838ee-143f-4708-af63-1d49693d24d5 tempest-VolumesTestJSON-619646775 tempest-VolumesTestJSON-619646775] 10.222.0.37 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.443724 Jan 15 02:39:11.123109 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 6/13] 10.222.0.37 () {58 vars in 1124 bytes} [Fri Jan 15 02:39:10 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:39:11.150536 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-21ed364e-2e40-40a4-bca5-3e0778b5ec69 tempest-VolumesTestJSON-619646775 tempest-VolumesTestJSON-619646775] Calling method '.version_select at 0x7f8790387d90>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:11.552155 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-21ed364e-2e40-40a4-bca5-3e0778b5ec69 tempest-VolumesTestJSON-619646775 tempest-VolumesTestJSON-619646775] 10.222.0.37 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.415194 Jan 15 02:39:11.552795 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 7/14] 10.222.0.37 () {58 vars in 1139 bytes} [Fri Jan 15 02:39:11 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:39:11.583626 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4694df36-53da-4c75-8ee1-5a1a3aee43ee tempest-VolumesTestJSON-619646775 tempest-VolumesTestJSON-619646775] Calling method '.version_select at 0x7f879038e7b8>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:11.602109 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c8df1fc7-b34e-4647-b431-aa3f90157a6b tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6681e7cd24a94e4b99434f9c3c04a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea5b3764f4a068aadc567e576c3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:11.669485 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c8df1fc7-b34e-4647-b431-aa3f90157a6b tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 200 len: 1214 microversion: 2.1 time: 0.711026 Jan 15 02:39:11.682887 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 8/15] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:10 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 1214 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:39:11.920558 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4694df36-53da-4c75-8ee1-5a1a3aee43ee tempest-VolumesTestJSON-619646775 tempest-VolumesTestJSON-619646775] 10.222.0.37 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.354048 Jan 15 02:39:11.922509 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 8/16] 10.222.0.37 () {58 vars in 1124 bytes} [Fri Jan 15 02:39:11 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:39:11.950372 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-83d701f1-e0b2-42d9-9148-14efdda5b4b2 tempest-VolumesTestJSON-619646775 tempest-VolumesTestJSON-619646775] Calling method '.version_select at 0x7f87904a7048>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:12.343653 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-83d701f1-e0b2-42d9-9148-14efdda5b4b2 tempest-VolumesTestJSON-619646775 tempest-VolumesTestJSON-619646775] 10.222.0.37 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.408463 Jan 15 02:39:12.345257 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 9/17] 10.222.0.37 () {58 vars in 1157 bytes} [Fri Jan 15 02:39:11 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:39:12.369275 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2b2ba6f6-26d4-4a1a-80fe-a52cf50eeba5 tempest-VolumesTestJSON-619646775 tempest-VolumesTestJSON-619646775] Calling method '.version_select at 0x7f8790387ae8>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:12.734964 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-58c10a54-a2de-4a80-8560-2c4197bbd72e tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:12.737114 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-58c10a54-a2de-4a80-8560-2c4197bbd72e tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:12.763060 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2b2ba6f6-26d4-4a1a-80fe-a52cf50eeba5 tempest-VolumesTestJSON-619646775 tempest-VolumesTestJSON-619646775] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.399133 Jan 15 02:39:12.772606 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 9/18] 10.222.0.37 () {58 vars in 1160 bytes} [Fri Jan 15 02:39:12 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:39:12.799368 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-58c10a54-a2de-4a80-8560-2c4197bbd72e tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:12.813487 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-48840199-94d6-494d-b413-e6be9511e19d tempest-VolumesTestJSON-619646775 tempest-VolumesTestJSON-619646775] Calling method '.version_select at 0x7f879038eae8>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:12.819655 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-58c10a54-a2de-4a80-8560-2c4197bbd72e tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:12.821833 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-58c10a54-a2de-4a80-8560-2c4197bbd72e tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:12.822471 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-58c10a54-a2de-4a80-8560-2c4197bbd72e tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:13.170006 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-48840199-94d6-494d-b413-e6be9511e19d tempest-VolumesTestJSON-619646775 tempest-VolumesTestJSON-619646775] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.380343 Jan 15 02:39:13.179608 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 10/19] 10.222.0.37 () {58 vars in 1145 bytes} [Fri Jan 15 02:39:12 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:39:13.242930 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4763614d-d779-4a38-85ea-ce73fd3909f0 tempest-VolumesTestJSON-619646775 tempest-VolumesTestJSON-619646775] Calling method '.version_select at 0x7f879038e1e0>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:13.355925 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-58c10a54-a2de-4a80-8560-2c4197bbd72e tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6681e7cd24a94e4b99434f9c3c04a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea5b3764f4a068aadc567e576c3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:13.388172 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-58c10a54-a2de-4a80-8560-2c4197bbd72e tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 200 len: 1218 microversion: 2.1 time: 0.691362 Jan 15 02:39:13.407227 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 10/20] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:12 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 1218 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:39:13.545032 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4763614d-d779-4a38-85ea-ce73fd3909f0 tempest-VolumesTestJSON-619646775 tempest-VolumesTestJSON-619646775] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.354716 Jan 15 02:39:13.561453 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 11/21] 10.222.0.37 () {58 vars in 1178 bytes} [Fri Jan 15 02:39:13 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:39:13.575847 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-078120c5-daf1-478b-87a5-99add081d4a4 tempest-VolumesTestJSON-619646775 tempest-VolumesTestJSON-619646775] Calling method '.version_select at 0x7f8790378f28>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:13.972430 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-078120c5-daf1-478b-87a5-99add081d4a4 tempest-VolumesTestJSON-619646775 tempest-VolumesTestJSON-619646775] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.417117 Jan 15 02:39:13.980762 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 11/22] 10.222.0.37 () {58 vars in 1145 bytes} [Fri Jan 15 02:39:13 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:39:14.448010 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-95128088-57f6-40dc-b429-603bb4c725a0 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:14.450528 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-95128088-57f6-40dc-b429-603bb4c725a0 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:14.486999 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-95128088-57f6-40dc-b429-603bb4c725a0 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:14.501369 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-95128088-57f6-40dc-b429-603bb4c725a0 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:14.512147 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-95128088-57f6-40dc-b429-603bb4c725a0 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:14.512897 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-95128088-57f6-40dc-b429-603bb4c725a0 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:15.046799 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-95128088-57f6-40dc-b429-603bb4c725a0 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6681e7cd24a94e4b99434f9c3c04a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea5b3764f4a068aadc567e576c3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:15.085532 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-95128088-57f6-40dc-b429-603bb4c725a0 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 200 len: 1274 microversion: 2.1 time: 0.652653 Jan 15 02:39:15.093639 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 12/23] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:14 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 1274 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:39:16.127424 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-35d680d8-41d9-45cf-96bd-03ed54b2960b tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:16.128231 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-35d680d8-41d9-45cf-96bd-03ed54b2960b tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:16.168224 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-35d680d8-41d9-45cf-96bd-03ed54b2960b tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:16.172787 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-35d680d8-41d9-45cf-96bd-03ed54b2960b tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:16.176747 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-35d680d8-41d9-45cf-96bd-03ed54b2960b tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:16.177286 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-35d680d8-41d9-45cf-96bd-03ed54b2960b tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:17.572569 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-35d680d8-41d9-45cf-96bd-03ed54b2960b tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6681e7cd24a94e4b99434f9c3c04a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea5b3764f4a068aadc567e576c3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:17.637315 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-35d680d8-41d9-45cf-96bd-03ed54b2960b tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 200 len: 1272 microversion: 2.1 time: 1.519985 Jan 15 02:39:17.646853 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 12/24] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:16 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 1272 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:39:18.680657 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c58dc4c7-378a-4fd1-8097-cc2aaa2c099c tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:18.691075 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c58dc4c7-378a-4fd1-8097-cc2aaa2c099c tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:18.716323 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c58dc4c7-378a-4fd1-8097-cc2aaa2c099c tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:18.725847 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c58dc4c7-378a-4fd1-8097-cc2aaa2c099c tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:18.728887 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c58dc4c7-378a-4fd1-8097-cc2aaa2c099c tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:18.734053 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c58dc4c7-378a-4fd1-8097-cc2aaa2c099c tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:19.177538 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c58dc4c7-378a-4fd1-8097-cc2aaa2c099c tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6681e7cd24a94e4b99434f9c3c04a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea5b3764f4a068aadc567e576c3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:19.220819 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c58dc4c7-378a-4fd1-8097-cc2aaa2c099c tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 200 len: 1272 microversion: 2.1 time: 0.551158 Jan 15 02:39:19.223501 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 13/25] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:18 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 1272 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:39:20.253541 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-760b12f7-e28a-491f-b6b4-3256f96f70a8 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:20.253541 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-760b12f7-e28a-491f-b6b4-3256f96f70a8 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:20.279595 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-760b12f7-e28a-491f-b6b4-3256f96f70a8 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:20.293945 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-760b12f7-e28a-491f-b6b4-3256f96f70a8 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:20.296723 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-760b12f7-e28a-491f-b6b4-3256f96f70a8 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:20.298114 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-760b12f7-e28a-491f-b6b4-3256f96f70a8 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:24.432226 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ce42db5e-50ef-4526-851a-a65c2bb95bf5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'create', calling method: .version_select at 0x7f8790ac5c80>, body: {"keypair": {"name": "tempest-keypair-1631292761"}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:39:24.580611 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-ce42db5e-50ef-4526-851a-a65c2bb95bf5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Getting quotas for project a4201fdfaa594ca28ac9f59debb11e2a. Resources: {'key_pairs'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:39:24.601759 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-ce42db5e-50ef-4526-851a-a65c2bb95bf5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Getting quotas for user 9698bc5c912a4f86a7f0961c3cd41364 and project a4201fdfaa594ca28ac9f59debb11e2a. Resources: {'key_pairs'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:39:24.786995 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-760b12f7-e28a-491f-b6b4-3256f96f70a8 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6681e7cd24a94e4b99434f9c3c04a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea5b3764f4a068aadc567e576c3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:24.942804 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-760b12f7-e28a-491f-b6b4-3256f96f70a8 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 200 len: 1314 microversion: 2.1 time: 4.691080 Jan 15 02:39:24.943933 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 13/26] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:20 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 1314 bytes in 4706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:39:25.302600 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-ce42db5e-50ef-4526-851a-a65c2bb95bf5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Getting quotas for project a4201fdfaa594ca28ac9f59debb11e2a. Resources: {'key_pairs'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:39:25.319210 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-ce42db5e-50ef-4526-851a-a65c2bb95bf5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Getting quotas for user 9698bc5c912a4f86a7f0961c3cd41364 and project a4201fdfaa594ca28ac9f59debb11e2a. Resources: {'key_pairs'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:39:25.411792 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ce42db5e-50ef-4526-851a-a65c2bb95bf5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 2.628601 Jan 15 02:39:25.445255 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 14/27] 10.222.0.37 () {62 vars in 1189 bytes} [Fri Jan 15 02:39:22 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 2656 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jan 15 02:39:26.062989 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b386f231-a211-4f72-9164-b6e8075ac54f tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:26.064282 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b386f231-a211-4f72-9164-b6e8075ac54f tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:26.141598 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b386f231-a211-4f72-9164-b6e8075ac54f tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:26.142479 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b386f231-a211-4f72-9164-b6e8075ac54f tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:26.170071 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b386f231-a211-4f72-9164-b6e8075ac54f tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:26.171080 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b386f231-a211-4f72-9164-b6e8075ac54f tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:28.009677 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1eb5379f-1945-4a68-90bb-9bf191c79112 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-387436067", "imageRef": "1807a1cb-835d-4a56-8751-82ffa40b12c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5815bec5-1640-456f-9c6a-7d2af0195824"}]}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:39:28.533860 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-1eb5379f-1945-4a68-90bb-9bf191c79112 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] validate_networks() for [('5815bec5-1640-456f-9c6a-7d2af0195824', None, None, None)] {{(pid=94111) validate_networks /opt/stack/nova/nova/network/neutron.py:2340}} Jan 15 02:39:28.969234 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b386f231-a211-4f72-9164-b6e8075ac54f tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6681e7cd24a94e4b99434f9c3c04a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea5b3764f4a068aadc567e576c3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:29.019260 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b386f231-a211-4f72-9164-b6e8075ac54f tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 200 len: 1314 microversion: 2.1 time: 3.043612 Jan 15 02:39:29.028470 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 14/28] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:25 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 1314 bytes in 3054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:39:30.060536 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-74f56231-f81a-45e5-b799-08cdc36313ce tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:30.065601 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-74f56231-f81a-45e5-b799-08cdc36313ce tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:30.087548 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-74f56231-f81a-45e5-b799-08cdc36313ce tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:30.090709 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-74f56231-f81a-45e5-b799-08cdc36313ce tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:30.093423 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-74f56231-f81a-45e5-b799-08cdc36313ce tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:30.095344 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-74f56231-f81a-45e5-b799-08cdc36313ce tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:31.751790 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-1eb5379f-1945-4a68-90bb-9bf191c79112 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Flavor limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 02:39:31.752528 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-1eb5379f-1945-4a68-90bb-9bf191c79112 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Image limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Jan 15 02:39:31.752721 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-1eb5379f-1945-4a68-90bb-9bf191c79112 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Flavor pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 02:39:31.753497 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-1eb5379f-1945-4a68-90bb-9bf191c79112 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Image pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Jan 15 02:39:31.754093 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-1eb5379f-1945-4a68-90bb-9bf191c79112 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Jan 15 02:39:31.771923 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1eb5379f-1945-4a68-90bb-9bf191c79112 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:31.779284 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1eb5379f-1945-4a68-90bb-9bf191c79112 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:31.782385 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1eb5379f-1945-4a68-90bb-9bf191c79112 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:31.789719 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1eb5379f-1945-4a68-90bb-9bf191c79112 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:31.853164 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-1eb5379f-1945-4a68-90bb-9bf191c79112 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Getting quotas for project 4b64b200cb604abaa2041c6ac66f630e. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:39:31.865717 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-1eb5379f-1945-4a68-90bb-9bf191c79112 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Getting quotas for user a581d3806bae40b78383585eef6b915a and project 4b64b200cb604abaa2041c6ac66f630e. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:39:31.893939 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1eb5379f-1945-4a68-90bb-9bf191c79112 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Going to run 1 instances... {{(pid=94111) _provision_instances /opt/stack/nova/nova/compute/api.py:1263}} Jan 15 02:39:31.898904 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1eb5379f-1945-4a68-90bb-9bf191c79112 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1807a1cb-835d-4a56-8751-82ffa40b12c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1661}} Jan 15 02:39:31.976019 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1eb5379f-1945-4a68-90bb-9bf191c79112 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.076555 Jan 15 02:39:31.984843 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 15/29] 10.222.0.37 () {60 vars in 1137 bytes} [Fri Jan 15 02:39:26 2021] POST /compute/v2.1/servers => generated 383 bytes in 5087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 02:39:32.643253 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-74f56231-f81a-45e5-b799-08cdc36313ce tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6681e7cd24a94e4b99434f9c3c04a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea5b3764f4a068aadc567e576c3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:32.692746 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-74f56231-f81a-45e5-b799-08cdc36313ce tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 200 len: 1314 microversion: 2.1 time: 2.641255 Jan 15 02:39:32.708606 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 15/30] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:30 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 1314 bytes in 2657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:39:32.773300 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5c779481-65c1-495e-96cc-d08d9232eb21 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:32.787321 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5c779481-65c1-495e-96cc-d08d9232eb21 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:33.740208 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c9e3abac-9e64-4884-b6a9-e2812883ebe0 tempest-VolumesNegativeTest-2133827380 tempest-VolumesNegativeTest-2133827380] Action: 'create', calling method: .version_select at 0x7f878fae4bf8>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1123046460", "metadata": {"Type": "work"}}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:39:33.758748 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c9e3abac-9e64-4884-b6a9-e2812883ebe0 tempest-VolumesNegativeTest-2133827380 tempest-VolumesNegativeTest-2133827380] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=94111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:39:33.759808 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c9e3abac-9e64-4884-b6a9-e2812883ebe0 tempest-VolumesNegativeTest-2133827380 tempest-VolumesNegativeTest-2133827380] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.773071 Jan 15 02:39:33.770311 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-5c779481-65c1-495e-96cc-d08d9232eb21 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:33.774966 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 16/31] 10.222.0.37 () {60 vars in 1146 bytes} [Fri Jan 15 02:39:31 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1789 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 02:39:33.811772 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5c779481-65c1-495e-96cc-d08d9232eb21 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1221 microversion: 2.1 time: 1.098010 Jan 15 02:39:33.816691 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 16/32] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:32 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1221 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:39:33.822116 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-663660f5-4cf3-4343-b7c4-3ea51bbe2fda tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:33.827899 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-663660f5-4cf3-4343-b7c4-3ea51bbe2fda tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:33.867042 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7ece72a8-05d1-4993-a9e0-d8ec929eb0ec tempest-VolumesNegativeTest-2133827380 tempest-VolumesNegativeTest-2133827380] Action: 'create', calling method: .version_select at 0x7f87903156a8>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-153997861", "metadata": {"Type": "work"}}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:39:33.871913 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-663660f5-4cf3-4343-b7c4-3ea51bbe2fda tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:33.874798 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7ece72a8-05d1-4993-a9e0-d8ec929eb0ec tempest-VolumesNegativeTest-2133827380 tempest-VolumesNegativeTest-2133827380] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:39:33.876918 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-663660f5-4cf3-4343-b7c4-3ea51bbe2fda tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:33.881167 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-663660f5-4cf3-4343-b7c4-3ea51bbe2fda tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:33.885838 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-663660f5-4cf3-4343-b7c4-3ea51bbe2fda tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:33.887180 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-7ece72a8-05d1-4993-a9e0-d8ec929eb0ec tempest-VolumesNegativeTest-2133827380 tempest-VolumesNegativeTest-2133827380] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.068115 Jan 15 02:39:33.890735 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 17/33] 10.222.0.37 () {60 vars in 1146 bytes} [Fri Jan 15 02:39:33 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 02:39:33.965780 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-523c7223-5681-4435-a2b8-32f7cf20e656 tempest-VolumesNegativeTest-2133827380 tempest-VolumesNegativeTest-2133827380] Action: 'create', calling method: .version_select at 0x7f87984e0840>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-378049300", "metadata": {"Type": "work"}}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:39:33.968255 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-523c7223-5681-4435-a2b8-32f7cf20e656 tempest-VolumesNegativeTest-2133827380 tempest-VolumesNegativeTest-2133827380] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:39:33.993568 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-523c7223-5681-4435-a2b8-32f7cf20e656 tempest-VolumesNegativeTest-2133827380 tempest-VolumesNegativeTest-2133827380] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.069168 Jan 15 02:39:33.994968 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 18/34] 10.222.0.37 () {60 vars in 1146 bytes} [Fri Jan 15 02:39:33 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 02:39:34.094458 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b6b8290f-1136-4906-ab19-3b749f2e9bf5 tempest-VolumesNegativeTest-2133827380 tempest-VolumesNegativeTest-2133827380] Calling method '.version_select at 0x7f87904a70d0>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:34.411185 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-b6b8290f-1136-4906-ab19-3b749f2e9bf5 tempest-VolumesNegativeTest-2133827380 tempest-VolumesNegativeTest-2133827380] HTTP exception thrown: Volume tempest-invalid-1652874943 could not be found. Jan 15 02:39:34.411844 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b6b8290f-1136-4906-ab19-3b749f2e9bf5 tempest-VolumesNegativeTest-2133827380 tempest-VolumesNegativeTest-2133827380] Returning 404 to user: Volume tempest-invalid-1652874943 could not be found. {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:39:34.412733 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b6b8290f-1136-4906-ab19-3b749f2e9bf5 tempest-VolumesNegativeTest-2133827380 tempest-VolumesNegativeTest-2133827380] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1652874943" status: 404 len: 99 microversion: 2.1 time: 0.407681 Jan 15 02:39:34.413742 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 19/35] 10.222.0.37 () {58 vars in 1208 bytes} [Fri Jan 15 02:39:34 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1652874943 => generated 99 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 02:39:34.437653 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-de3767a6-1440-4460-b785-dba769299847 tempest-VolumesNegativeTest-2133827380 tempest-VolumesNegativeTest-2133827380] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010084 Jan 15 02:39:34.438368 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 20/36] 10.222.0.37 () {58 vars in 1130 bytes} [Fri Jan 15 02:39:34 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jan 15 02:39:34.481131 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4d5d2750-f748-4be3-9299-ae8433c79964 tempest-VolumesNegativeTest-2133827380 tempest-VolumesNegativeTest-2133827380] 10.222.0.37 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.032556 Jan 15 02:39:34.512855 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 21/37] 10.222.0.37 () {58 vars in 1127 bytes} [Fri Jan 15 02:39:34 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 15 02:39:34.554175 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-075b6058-8d57-4138-bc56-9af04a552deb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1010540171", "imageRef": "1807a1cb-835d-4a56-8751-82ffa40b12c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5815bec5-1640-456f-9c6a-7d2af0195824"}]}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:39:34.831145 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-075b6058-8d57-4138-bc56-9af04a552deb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] validate_networks() for [('5815bec5-1640-456f-9c6a-7d2af0195824', None, None, None)] {{(pid=94112) validate_networks /opt/stack/nova/nova/network/neutron.py:2340}} Jan 15 02:39:35.031570 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-663660f5-4cf3-4343-b7c4-3ea51bbe2fda tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6681e7cd24a94e4b99434f9c3c04a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea5b3764f4a068aadc567e576c3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:35.058719 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-663660f5-4cf3-4343-b7c4-3ea51bbe2fda tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 200 len: 1314 microversion: 2.1 time: 1.281047 Jan 15 02:39:35.059906 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 17/38] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:33 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 1314 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:39:35.109716 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a0dc896c-ed05-4f6d-81c7-9ba45f2900e1 tempest-VolumesNegativeTest-2133827380 tempest-VolumesNegativeTest-2133827380] Calling method '.version_select at 0x7f878fa7ef28>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:35.441906 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-a0dc896c-ed05-4f6d-81c7-9ba45f2900e1 tempest-VolumesNegativeTest-2133827380 tempest-VolumesNegativeTest-2133827380] HTTP exception thrown: Volume 1d139741-e11f-46b9-8fde-f3f49c64b79b could not be found. Jan 15 02:39:35.442885 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a0dc896c-ed05-4f6d-81c7-9ba45f2900e1 tempest-VolumesNegativeTest-2133827380 tempest-VolumesNegativeTest-2133827380] Returning 404 to user: Volume 1d139741-e11f-46b9-8fde-f3f49c64b79b could not be found. {{(pid=94111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:39:35.443990 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a0dc896c-ed05-4f6d-81c7-9ba45f2900e1 tempest-VolumesNegativeTest-2133827380 tempest-VolumesNegativeTest-2133827380] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/1d139741-e11f-46b9-8fde-f3f49c64b79b" status: 404 len: 109 microversion: 2.1 time: 0.375842 Jan 15 02:39:35.445034 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 18/39] 10.222.0.37 () {58 vars in 1238 bytes} [Fri Jan 15 02:39:35 2021] DELETE /compute/v2.1/os-volumes/1d139741-e11f-46b9-8fde-f3f49c64b79b => generated 109 bytes in 384 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:39:35.475440 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-572a6d2f-8dc5-409b-ae30-48937a6a3deb tempest-VolumesNegativeTest-2133827380 tempest-VolumesNegativeTest-2133827380] Calling method '.version_select at 0x7f8790387bf8>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:35.906525 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-572a6d2f-8dc5-409b-ae30-48937a6a3deb tempest-VolumesNegativeTest-2133827380 tempest-VolumesNegativeTest-2133827380] HTTP exception thrown: Volume 7620e269-09ce-4cdb-8311-005031f8e165 could not be found. Jan 15 02:39:35.908569 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-572a6d2f-8dc5-409b-ae30-48937a6a3deb tempest-VolumesNegativeTest-2133827380 tempest-VolumesNegativeTest-2133827380] Returning 404 to user: Volume 7620e269-09ce-4cdb-8311-005031f8e165 could not be found. {{(pid=94111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:39:35.911133 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-572a6d2f-8dc5-409b-ae30-48937a6a3deb tempest-VolumesNegativeTest-2133827380 tempest-VolumesNegativeTest-2133827380] 10.222.0.37 "GET /compute/v2.1/os-volumes/7620e269-09ce-4cdb-8311-005031f8e165" status: 404 len: 109 microversion: 2.1 time: 0.456250 Jan 15 02:39:35.926854 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 19/40] 10.222.0.37 () {58 vars in 1235 bytes} [Fri Jan 15 02:39:35 2021] GET /compute/v2.1/os-volumes/7620e269-09ce-4cdb-8311-005031f8e165 => generated 109 bytes in 473 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:39:36.124972 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1e8f5ac6-24ba-44ba-8a67-205faa1faad8 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:36.126272 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1e8f5ac6-24ba-44ba-8a67-205faa1faad8 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:36.159978 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1e8f5ac6-24ba-44ba-8a67-205faa1faad8 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:36.160899 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1e8f5ac6-24ba-44ba-8a67-205faa1faad8 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:36.162560 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1e8f5ac6-24ba-44ba-8a67-205faa1faad8 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:36.163517 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1e8f5ac6-24ba-44ba-8a67-205faa1faad8 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:39.703906 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1e8f5ac6-24ba-44ba-8a67-205faa1faad8 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6681e7cd24a94e4b99434f9c3c04a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea5b3764f4a068aadc567e576c3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:39.733461 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1e8f5ac6-24ba-44ba-8a67-205faa1faad8 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 200 len: 1314 microversion: 2.1 time: 3.642997 Jan 15 02:39:39.755815 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 20/41] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:36 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 1314 bytes in 3668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:39:39.837994 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4038aac6-5f2f-4954-b3f8-df979e4032a7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2058252467", "imageRef": "1807a1cb-835d-4a56-8751-82ffa40b12c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64576b11-ff23-432d-a6d4-0c0a0fbf857f"}], "security_groups": [{"name": "tempest-securitygroup--989154930"}], "key_name": "tempest-keypair-1631292761", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:39:40.262556 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-4038aac6-5f2f-4954-b3f8-df979e4032a7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] validate_networks() for [('64576b11-ff23-432d-a6d4-0c0a0fbf857f', None, None, None)] {{(pid=94111) validate_networks /opt/stack/nova/nova/network/neutron.py:2340}} Jan 15 02:39:40.850595 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-075b6058-8d57-4138-bc56-9af04a552deb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Flavor limits 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 02:39:40.851728 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-075b6058-8d57-4138-bc56-9af04a552deb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Image limits 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Jan 15 02:39:40.852614 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-075b6058-8d57-4138-bc56-9af04a552deb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Flavor pref 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 02:39:40.853431 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-075b6058-8d57-4138-bc56-9af04a552deb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Image pref 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Jan 15 02:39:40.854125 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-075b6058-8d57-4138-bc56-9af04a552deb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Jan 15 02:39:40.890994 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-075b6058-8d57-4138-bc56-9af04a552deb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:40.897218 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-075b6058-8d57-4138-bc56-9af04a552deb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:40.903447 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-075b6058-8d57-4138-bc56-9af04a552deb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:40.905219 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-075b6058-8d57-4138-bc56-9af04a552deb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:41.026421 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-075b6058-8d57-4138-bc56-9af04a552deb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Getting quotas for project 4b64b200cb604abaa2041c6ac66f630e. Resources: {'ram', 'instances', 'cores'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:39:41.058904 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-075b6058-8d57-4138-bc56-9af04a552deb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Getting quotas for user a581d3806bae40b78383585eef6b915a and project 4b64b200cb604abaa2041c6ac66f630e. Resources: {'ram', 'instances', 'cores'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:39:41.132257 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-075b6058-8d57-4138-bc56-9af04a552deb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Going to run 1 instances... {{(pid=94112) _provision_instances /opt/stack/nova/nova/compute/api.py:1263}} Jan 15 02:39:41.145833 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-075b6058-8d57-4138-bc56-9af04a552deb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1807a1cb-835d-4a56-8751-82ffa40b12c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94112) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1661}} Jan 15 02:39:41.601430 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-075b6058-8d57-4138-bc56-9af04a552deb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.080262 Jan 15 02:39:41.611159 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 22/42] 10.222.0.37 () {60 vars in 1137 bytes} [Fri Jan 15 02:39:34 2021] POST /compute/v2.1/servers => generated 383 bytes in 7095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 02:39:41.722253 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4493b9f5-b403-42c2-9dc3-fa839a4c96b5 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:41.731921 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4493b9f5-b403-42c2-9dc3-fa839a4c96b5 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:41.801597 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4493b9f5-b403-42c2-9dc3-fa839a4c96b5 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:41.802455 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4493b9f5-b403-42c2-9dc3-fa839a4c96b5 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:41.813267 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4493b9f5-b403-42c2-9dc3-fa839a4c96b5 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:41.828306 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4493b9f5-b403-42c2-9dc3-fa839a4c96b5 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:43.211946 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4493b9f5-b403-42c2-9dc3-fa839a4c96b5 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6681e7cd24a94e4b99434f9c3c04a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea5b3764f4a068aadc567e576c3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:43.238249 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4493b9f5-b403-42c2-9dc3-fa839a4c96b5 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 200 len: 1314 microversion: 2.1 time: 1.624681 Jan 15 02:39:43.241229 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 23/43] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:41 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 1314 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:39:43.269331 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-bd9d46da-56f8-41bf-9e18-4258c8de1417 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:43.271074 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-bd9d46da-56f8-41bf-9e18-4258c8de1417 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:43.288963 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bd9d46da-56f8-41bf-9e18-4258c8de1417 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:43.289992 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bd9d46da-56f8-41bf-9e18-4258c8de1417 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:43.293601 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bd9d46da-56f8-41bf-9e18-4258c8de1417 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:43.296870 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bd9d46da-56f8-41bf-9e18-4258c8de1417 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:43.665712 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-bd9d46da-56f8-41bf-9e18-4258c8de1417 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:43.665712 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-bd9d46da-56f8-41bf-9e18-4258c8de1417 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1218 microversion: 2.1 time: 0.421096 Jan 15 02:39:43.665712 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 24/44] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:43 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1218 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:39:44.294189 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-caae80b7-231b-49b4-b60c-fd62aac02550 req-2114fd9c-bd03-4310-8599-33d73f599ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67ce428a-3f61-43ae-98d8-8b18cd00be8f", "tag": "02a8485a-e56a-4105-ad1a-f54c75e86b46"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:39:44.311634 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:39:44.311634 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:39:44.337294 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-caae80b7-231b-49b4-b60c-fd62aac02550 req-2114fd9c-bd03-4310-8599-33d73f599ee9 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:44.339336 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-caae80b7-231b-49b4-b60c-fd62aac02550 req-2114fd9c-bd03-4310-8599-33d73f599ee9 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:44.364943 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-4038aac6-5f2f-4954-b3f8-df979e4032a7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Flavor limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 02:39:44.365422 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-4038aac6-5f2f-4954-b3f8-df979e4032a7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Image limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Jan 15 02:39:44.366111 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-4038aac6-5f2f-4954-b3f8-df979e4032a7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Flavor pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 02:39:44.366686 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-4038aac6-5f2f-4954-b3f8-df979e4032a7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Image pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Jan 15 02:39:44.367407 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-4038aac6-5f2f-4954-b3f8-df979e4032a7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Jan 15 02:39:44.384691 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-caae80b7-231b-49b4-b60c-fd62aac02550 req-2114fd9c-bd03-4310-8599-33d73f599ee9 service nova] Creating event network-changed:02a8485a-e56a-4105-ad1a-f54c75e86b46 for instance 67ce428a-3f61-43ae-98d8-8b18cd00be8f on hv-cinder-76330 Jan 15 02:39:44.386313 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-caae80b7-231b-49b4-b60c-fd62aac02550 req-2114fd9c-bd03-4310-8599-33d73f599ee9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=94112) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Jan 15 02:39:44.389398 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4038aac6-5f2f-4954-b3f8-df979e4032a7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:44.390109 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4038aac6-5f2f-4954-b3f8-df979e4032a7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:44.391286 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4038aac6-5f2f-4954-b3f8-df979e4032a7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:44.391739 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c8fc8577-60c3-452b-aa13-42b81b1dc493 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:44.392135 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4038aac6-5f2f-4954-b3f8-df979e4032a7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:44.392254 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c8fc8577-60c3-452b-aa13-42b81b1dc493 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:44.393287 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c8fc8577-60c3-452b-aa13-42b81b1dc493 None None] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:44.393663 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c8fc8577-60c3-452b-aa13-42b81b1dc493 None None] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:44.422237 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.compute.rpcapi [None req-c8fc8577-60c3-452b-aa13-42b81b1dc493 None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Jan 15 02:39:44.424254 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c8fc8577-60c3-452b-aa13-42b81b1dc493 None None] Releasing lock "compute-rpcapi-router" {{(pid=94112) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Jan 15 02:39:44.444077 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-4038aac6-5f2f-4954-b3f8-df979e4032a7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Getting quotas for project a4201fdfaa594ca28ac9f59debb11e2a. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:39:44.449329 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-4038aac6-5f2f-4954-b3f8-df979e4032a7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Getting quotas for user 9698bc5c912a4f86a7f0961c3cd41364 and project a4201fdfaa594ca28ac9f59debb11e2a. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:39:44.478946 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4038aac6-5f2f-4954-b3f8-df979e4032a7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Going to run 1 instances... {{(pid=94111) _provision_instances /opt/stack/nova/nova/compute/api.py:1263}} Jan 15 02:39:44.482781 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4038aac6-5f2f-4954-b3f8-df979e4032a7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1807a1cb-835d-4a56-8751-82ffa40b12c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1661}} Jan 15 02:39:44.488400 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c8fc8577-60c3-452b-aa13-42b81b1dc493 None None] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.821677 Jan 15 02:39:44.489374 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 25/45] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:39:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:39:44.523105 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d5fb6c60-7d26-47cd-b5db-ac2faa8e705f tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:44.524374 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d5fb6c60-7d26-47cd-b5db-ac2faa8e705f tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:44.550652 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d5fb6c60-7d26-47cd-b5db-ac2faa8e705f tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:44.553290 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d5fb6c60-7d26-47cd-b5db-ac2faa8e705f tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:44.556130 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d5fb6c60-7d26-47cd-b5db-ac2faa8e705f tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:44.557473 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d5fb6c60-7d26-47cd-b5db-ac2faa8e705f tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:44.635479 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4038aac6-5f2f-4954-b3f8-df979e4032a7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.845433 Jan 15 02:39:44.643913 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 21/46] 10.222.0.37 () {62 vars in 1178 bytes} [Fri Jan 15 02:39:39 2021] POST /compute/v2.1/servers => generated 401 bytes in 4855 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 15 02:39:44.667144 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-dcdd6cac-8973-4c0d-8056-116c204d8c14 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:44.675329 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-dcdd6cac-8973-4c0d-8056-116c204d8c14 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:44.941497 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-dcdd6cac-8973-4c0d-8056-116c204d8c14 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:44.991154 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-dcdd6cac-8973-4c0d-8056-116c204d8c14 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:45.008206 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-dcdd6cac-8973-4c0d-8056-116c204d8c14 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:45.030831 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-dcdd6cac-8973-4c0d-8056-116c204d8c14 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1282 microversion: 2.20 time: 0.379949 Jan 15 02:39:45.033310 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 22/47] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:39:44 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1282 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:39:45.058821 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c8cb00d4-9677-409c-8506-6fa3d3c7dd0e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:45.064169 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c8cb00d4-9677-409c-8506-6fa3d3c7dd0e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:45.095239 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c8cb00d4-9677-409c-8506-6fa3d3c7dd0e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:45.102193 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c8cb00d4-9677-409c-8506-6fa3d3c7dd0e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:45.103951 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c8cb00d4-9677-409c-8506-6fa3d3c7dd0e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:45.106242 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c8cb00d4-9677-409c-8506-6fa3d3c7dd0e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:45.762864 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d5fb6c60-7d26-47cd-b5db-ac2faa8e705f tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6681e7cd24a94e4b99434f9c3c04a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea5b3764f4a068aadc567e576c3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:45.786761 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d5fb6c60-7d26-47cd-b5db-ac2faa8e705f tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 200 len: 1314 microversion: 2.1 time: 1.295604 Jan 15 02:39:45.787506 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 26/48] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:44 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 1314 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:39:46.062900 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b6d03308-808e-43ec-8a12-44a54f5b0790 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:46.066652 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b6d03308-808e-43ec-8a12-44a54f5b0790 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:46.093448 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b6d03308-808e-43ec-8a12-44a54f5b0790 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:46.093964 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b6d03308-808e-43ec-8a12-44a54f5b0790 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:46.094837 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b6d03308-808e-43ec-8a12-44a54f5b0790 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:46.101777 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b6d03308-808e-43ec-8a12-44a54f5b0790 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:46.155786 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c8cb00d4-9677-409c-8506-6fa3d3c7dd0e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:46.190998 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c8cb00d4-9677-409c-8506-6fa3d3c7dd0e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1280 microversion: 2.1 time: 1.156064 Jan 15 02:39:46.198194 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 23/49] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:45 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1280 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:39:46.606602 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b6d03308-808e-43ec-8a12-44a54f5b0790 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:46.635031 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b6d03308-808e-43ec-8a12-44a54f5b0790 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:46.652573 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b6d03308-808e-43ec-8a12-44a54f5b0790 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:46.655998 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b6d03308-808e-43ec-8a12-44a54f5b0790 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1278 microversion: 2.20 time: 0.609463 Jan 15 02:39:46.670399 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 27/50] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:39:46 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1278 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:39:46.826135 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-365492c2-ac46-4333-8ac1-2092aa4517c6 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:46.828592 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-365492c2-ac46-4333-8ac1-2092aa4517c6 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:46.845952 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-365492c2-ac46-4333-8ac1-2092aa4517c6 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:46.847490 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-365492c2-ac46-4333-8ac1-2092aa4517c6 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:46.850044 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-365492c2-ac46-4333-8ac1-2092aa4517c6 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:46.851418 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-365492c2-ac46-4333-8ac1-2092aa4517c6 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:47.216834 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e9e6c712-c513-4d2f-91cb-b143c118c0c7 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:47.217694 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e9e6c712-c513-4d2f-91cb-b143c118c0c7 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:47.250012 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e9e6c712-c513-4d2f-91cb-b143c118c0c7 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:47.250529 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e9e6c712-c513-4d2f-91cb-b143c118c0c7 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:47.251401 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e9e6c712-c513-4d2f-91cb-b143c118c0c7 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:47.251902 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e9e6c712-c513-4d2f-91cb-b143c118c0c7 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:47.624504 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e9e6c712-c513-4d2f-91cb-b143c118c0c7 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:47.665696 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e9e6c712-c513-4d2f-91cb-b143c118c0c7 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1280 microversion: 2.1 time: 0.459275 Jan 15 02:39:47.667846 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 28/51] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:47 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1280 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:39:47.725397 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-dbaeeb1c-91b0-4852-88f2-6438ea2969ce tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:47.729710 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-dbaeeb1c-91b0-4852-88f2-6438ea2969ce tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:47.767924 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dbaeeb1c-91b0-4852-88f2-6438ea2969ce tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:47.770473 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dbaeeb1c-91b0-4852-88f2-6438ea2969ce tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:47.778052 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dbaeeb1c-91b0-4852-88f2-6438ea2969ce tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:47.780123 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dbaeeb1c-91b0-4852-88f2-6438ea2969ce tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:48.476012 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-dbaeeb1c-91b0-4852-88f2-6438ea2969ce tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:48.519274 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-dbaeeb1c-91b0-4852-88f2-6438ea2969ce tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:48.547113 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-dbaeeb1c-91b0-4852-88f2-6438ea2969ce tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:48.548631 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-dbaeeb1c-91b0-4852-88f2-6438ea2969ce tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1340 microversion: 2.20 time: 0.859550 Jan 15 02:39:48.562171 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 29/52] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:39:47 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1340 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:39:48.694058 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f66b5ede-ee3f-4c40-868c-9bd1a02c594e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:48.705946 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f66b5ede-ee3f-4c40-868c-9bd1a02c594e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:48.739509 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f66b5ede-ee3f-4c40-868c-9bd1a02c594e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:48.740358 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f66b5ede-ee3f-4c40-868c-9bd1a02c594e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:48.744665 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f66b5ede-ee3f-4c40-868c-9bd1a02c594e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:48.745462 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f66b5ede-ee3f-4c40-868c-9bd1a02c594e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:49.387931 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-365492c2-ac46-4333-8ac1-2092aa4517c6 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6681e7cd24a94e4b99434f9c3c04a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea5b3764f4a068aadc567e576c3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:49.419146 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-365492c2-ac46-4333-8ac1-2092aa4517c6 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 200 len: 1314 microversion: 2.1 time: 2.616426 Jan 15 02:39:49.441628 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 24/53] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:46 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 1314 bytes in 2640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:39:50.098918 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-fa3013cd-0cf9-4bf2-a463-1363bf5a3e54 req-657231e3-0532-4be4-9dd0-d881eec602fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67ce428a-3f61-43ae-98d8-8b18cd00be8f", "name": "network-vif-plugged", "status": "completed", "tag": "02a8485a-e56a-4105-ad1a-f54c75e86b46"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:39:50.114698 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f66b5ede-ee3f-4c40-868c-9bd1a02c594e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:50.134714 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:39:50.134714 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:39:50.148882 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f66b5ede-ee3f-4c40-868c-9bd1a02c594e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1280 microversion: 2.1 time: 1.462383 Jan 15 02:39:50.150411 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 30/54] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:48 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1280 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:39:50.169221 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-fa3013cd-0cf9-4bf2-a463-1363bf5a3e54 req-657231e3-0532-4be4-9dd0-d881eec602fd service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:50.170675 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-fa3013cd-0cf9-4bf2-a463-1363bf5a3e54 req-657231e3-0532-4be4-9dd0-d881eec602fd service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:50.197913 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5820190a-a8e4-4dc7-84c9-c0dc77f0d293 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:50.199305 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5820190a-a8e4-4dc7-84c9-c0dc77f0d293 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:50.236813 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5820190a-a8e4-4dc7-84c9-c0dc77f0d293 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:50.237826 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5820190a-a8e4-4dc7-84c9-c0dc77f0d293 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:50.240332 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5820190a-a8e4-4dc7-84c9-c0dc77f0d293 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:50.241299 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-fa3013cd-0cf9-4bf2-a463-1363bf5a3e54 req-657231e3-0532-4be4-9dd0-d881eec602fd service nova] Creating event network-vif-plugged:02a8485a-e56a-4105-ad1a-f54c75e86b46 for instance 67ce428a-3f61-43ae-98d8-8b18cd00be8f on hv-cinder-76330 Jan 15 02:39:50.242506 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-fa3013cd-0cf9-4bf2-a463-1363bf5a3e54 req-657231e3-0532-4be4-9dd0-d881eec602fd service nova] Acquired lock "compute-rpcapi-router" {{(pid=94111) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Jan 15 02:39:50.244841 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1c28a28f-4a49-46d8-8eed-e6a2853603cb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:50.245181 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5820190a-a8e4-4dc7-84c9-c0dc77f0d293 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:50.255748 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1c28a28f-4a49-46d8-8eed-e6a2853603cb None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:50.257746 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1c28a28f-4a49-46d8-8eed-e6a2853603cb None None] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:50.258957 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1c28a28f-4a49-46d8-8eed-e6a2853603cb None None] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:50.297806 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.compute.rpcapi [None req-1c28a28f-4a49-46d8-8eed-e6a2853603cb None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Jan 15 02:39:50.300395 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1c28a28f-4a49-46d8-8eed-e6a2853603cb None None] Releasing lock "compute-rpcapi-router" {{(pid=94111) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Jan 15 02:39:50.358935 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1c28a28f-4a49-46d8-8eed-e6a2853603cb None None] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.913965 Jan 15 02:39:50.361113 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 25/55] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:39:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:39:50.482996 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1cc6f8c7-cf7f-47a8-90b2-e2d8eec07b42 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:50.489448 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1cc6f8c7-cf7f-47a8-90b2-e2d8eec07b42 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:50.528131 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1cc6f8c7-cf7f-47a8-90b2-e2d8eec07b42 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:50.533999 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1cc6f8c7-cf7f-47a8-90b2-e2d8eec07b42 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:50.537699 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1cc6f8c7-cf7f-47a8-90b2-e2d8eec07b42 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:50.542829 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1cc6f8c7-cf7f-47a8-90b2-e2d8eec07b42 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:51.361465 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-5820190a-a8e4-4dc7-84c9-c0dc77f0d293 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:51.399327 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-5820190a-a8e4-4dc7-84c9-c0dc77f0d293 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:51.416379 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-5820190a-a8e4-4dc7-84c9-c0dc77f0d293 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:51.419062 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5820190a-a8e4-4dc7-84c9-c0dc77f0d293 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1340 microversion: 2.20 time: 1.266463 Jan 15 02:39:51.420549 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 31/56] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:39:50 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1340 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:39:51.588465 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-62f3fb92-9c69-4f93-b46b-a30ee92570bc req-b7451359-b21d-4dbd-ba58-0d8376f5d495 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e90ce195-f423-416c-859f-a6423d99efe6", "tag": "c7862d6e-e0db-48c4-b9d1-6f1b89942a89"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:39:51.597547 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:39:51.597547 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:39:51.610237 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-62f3fb92-9c69-4f93-b46b-a30ee92570bc req-b7451359-b21d-4dbd-ba58-0d8376f5d495 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:51.610846 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-62f3fb92-9c69-4f93-b46b-a30ee92570bc req-b7451359-b21d-4dbd-ba58-0d8376f5d495 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:51.651213 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-62f3fb92-9c69-4f93-b46b-a30ee92570bc req-b7451359-b21d-4dbd-ba58-0d8376f5d495 service nova] Creating event network-changed:c7862d6e-e0db-48c4-b9d1-6f1b89942a89 for instance e90ce195-f423-416c-859f-a6423d99efe6 on hv-cinder-76330 Jan 15 02:39:51.668134 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-62f3fb92-9c69-4f93-b46b-a30ee92570bc req-b7451359-b21d-4dbd-ba58-0d8376f5d495 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245373 Jan 15 02:39:51.669054 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 32/57] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:39:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:39:51.682291 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-26fefb87-21fd-477f-a77c-4e6c29795f11 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:51.683382 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-26fefb87-21fd-477f-a77c-4e6c29795f11 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:51.692738 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-26fefb87-21fd-477f-a77c-4e6c29795f11 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:51.693348 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-26fefb87-21fd-477f-a77c-4e6c29795f11 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:51.694253 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-26fefb87-21fd-477f-a77c-4e6c29795f11 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:51.694800 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-26fefb87-21fd-477f-a77c-4e6c29795f11 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:52.015260 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1cc6f8c7-cf7f-47a8-90b2-e2d8eec07b42 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6681e7cd24a94e4b99434f9c3c04a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea5b3764f4a068aadc567e576c3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:52.058391 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1cc6f8c7-cf7f-47a8-90b2-e2d8eec07b42 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 200 len: 1314 microversion: 2.1 time: 1.605817 Jan 15 02:39:52.059805 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 26/58] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:50 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 1314 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:39:52.468976 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-09290d9e-8195-454d-a0b4-dfa4fffa18dc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:52.471040 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-09290d9e-8195-454d-a0b4-dfa4fffa18dc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:52.483592 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-09290d9e-8195-454d-a0b4-dfa4fffa18dc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:52.484469 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-09290d9e-8195-454d-a0b4-dfa4fffa18dc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:52.486072 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-09290d9e-8195-454d-a0b4-dfa4fffa18dc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:52.486995 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-09290d9e-8195-454d-a0b4-dfa4fffa18dc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:53.096202 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-09290d9e-8195-454d-a0b4-dfa4fffa18dc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:53.157285 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-09290d9e-8195-454d-a0b4-dfa4fffa18dc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:53.178667 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-09290d9e-8195-454d-a0b4-dfa4fffa18dc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:53.181537 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-09290d9e-8195-454d-a0b4-dfa4fffa18dc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1340 microversion: 2.20 time: 0.743256 Jan 15 02:39:53.192286 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 27/59] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:39:52 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1340 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:39:53.231110 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-000d3bd7-a40c-4875-bbea-0d6e47c441ce tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:53.234453 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-000d3bd7-a40c-4875-bbea-0d6e47c441ce tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:53.276879 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-000d3bd7-a40c-4875-bbea-0d6e47c441ce tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:53.278231 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-000d3bd7-a40c-4875-bbea-0d6e47c441ce tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:53.280515 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-000d3bd7-a40c-4875-bbea-0d6e47c441ce tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:53.281651 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-000d3bd7-a40c-4875-bbea-0d6e47c441ce tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:53.721043 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-26fefb87-21fd-477f-a77c-4e6c29795f11 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:53.751487 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-26fefb87-21fd-477f-a77c-4e6c29795f11 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1322 microversion: 2.1 time: 2.079915 Jan 15 02:39:53.752929 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 33/60] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:51 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1322 bytes in 2083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:39:54.265435 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e021cb5f-627f-44f7-92ce-f18dc6a844da tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:54.274942 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e021cb5f-627f-44f7-92ce-f18dc6a844da tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:54.296223 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e021cb5f-627f-44f7-92ce-f18dc6a844da tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:54.297392 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e021cb5f-627f-44f7-92ce-f18dc6a844da tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:54.299190 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e021cb5f-627f-44f7-92ce-f18dc6a844da tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:54.300545 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e021cb5f-627f-44f7-92ce-f18dc6a844da tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:55.402594 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-000d3bd7-a40c-4875-bbea-0d6e47c441ce tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6681e7cd24a94e4b99434f9c3c04a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea5b3764f4a068aadc567e576c3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:55.420862 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-000d3bd7-a40c-4875-bbea-0d6e47c441ce tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 200 len: 1314 microversion: 2.1 time: 2.225154 Jan 15 02:39:55.422039 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 28/61] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:53 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 1314 bytes in 2229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:39:55.445473 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-646c3e28-fd38-4f2a-a70a-6f1f6cfd02af tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:55.447002 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-646c3e28-fd38-4f2a-a70a-6f1f6cfd02af tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:55.464554 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-646c3e28-fd38-4f2a-a70a-6f1f6cfd02af tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:55.465776 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-646c3e28-fd38-4f2a-a70a-6f1f6cfd02af tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:55.470482 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-646c3e28-fd38-4f2a-a70a-6f1f6cfd02af tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:55.472140 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-646c3e28-fd38-4f2a-a70a-6f1f6cfd02af tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:56.475371 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e021cb5f-627f-44f7-92ce-f18dc6a844da tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:56.532369 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e021cb5f-627f-44f7-92ce-f18dc6a844da tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:56.555413 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-646c3e28-fd38-4f2a-a70a-6f1f6cfd02af tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:56.567993 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e021cb5f-627f-44f7-92ce-f18dc6a844da tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:56.580171 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e021cb5f-627f-44f7-92ce-f18dc6a844da tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1407 microversion: 2.20 time: 2.366060 Jan 15 02:39:56.581642 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 34/62] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:39:54 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1407 bytes in 2370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:39:56.615261 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3085db32-b676-42a0-a733-d6f6dc20aade tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:56.620308 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-646c3e28-fd38-4f2a-a70a-6f1f6cfd02af tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1322 microversion: 2.1 time: 1.196174 Jan 15 02:39:56.625564 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 29/63] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:55 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1322 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:39:56.668689 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3085db32-b676-42a0-a733-d6f6dc20aade tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:56.744101 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3085db32-b676-42a0-a733-d6f6dc20aade tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:56.745047 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3085db32-b676-42a0-a733-d6f6dc20aade tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:56.754946 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3085db32-b676-42a0-a733-d6f6dc20aade tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:56.755833 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3085db32-b676-42a0-a733-d6f6dc20aade tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:56.994799 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-2ff3fbf7-60b6-4861-ad2d-2c38ff3896e9 req-3d742505-cab8-4b04-b628-f3a69c10a362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e90ce195-f423-416c-859f-a6423d99efe6", "name": "network-vif-plugged", "status": "completed", "tag": "c7862d6e-e0db-48c4-b9d1-6f1b89942a89"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:39:57.024799 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:39:57.024799 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:39:57.068311 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-2ff3fbf7-60b6-4861-ad2d-2c38ff3896e9 req-3d742505-cab8-4b04-b628-f3a69c10a362 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:57.069244 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-2ff3fbf7-60b6-4861-ad2d-2c38ff3896e9 req-3d742505-cab8-4b04-b628-f3a69c10a362 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:57.151240 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-2ff3fbf7-60b6-4861-ad2d-2c38ff3896e9 req-3d742505-cab8-4b04-b628-f3a69c10a362 service nova] Creating event network-vif-plugged:c7862d6e-e0db-48c4-b9d1-6f1b89942a89 for instance e90ce195-f423-416c-859f-a6423d99efe6 on hv-cinder-76330 Jan 15 02:39:57.177617 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-2ff3fbf7-60b6-4861-ad2d-2c38ff3896e9 req-3d742505-cab8-4b04-b628-f3a69c10a362 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.233367 Jan 15 02:39:57.179488 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 30/64] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:39:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:39:57.660089 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f89ad5e1-acdd-4caa-8c8f-b0c123905cb2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:57.664344 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f89ad5e1-acdd-4caa-8c8f-b0c123905cb2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:57.707253 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f89ad5e1-acdd-4caa-8c8f-b0c123905cb2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:57.710867 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f89ad5e1-acdd-4caa-8c8f-b0c123905cb2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:57.715602 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f89ad5e1-acdd-4caa-8c8f-b0c123905cb2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:57.720107 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f89ad5e1-acdd-4caa-8c8f-b0c123905cb2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:58.376036 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3085db32-b676-42a0-a733-d6f6dc20aade tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6681e7cd24a94e4b99434f9c3c04a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea5b3764f4a068aadc567e576c3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:58.397340 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3085db32-b676-42a0-a733-d6f6dc20aade tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 200 len: 1500 microversion: 2.1 time: 1.813792 Jan 15 02:39:58.397961 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 35/65] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:56 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 1500 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:39:58.439915 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c416bc5a-47a3-488c-a118-c4a14fe9446e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:39:58.440793 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c416bc5a-47a3-488c-a118-c4a14fe9446e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:39:58.452527 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c416bc5a-47a3-488c-a118-c4a14fe9446e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:58.461661 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c416bc5a-47a3-488c-a118-c4a14fe9446e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:58.462848 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c416bc5a-47a3-488c-a118-c4a14fe9446e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:39:58.463498 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c416bc5a-47a3-488c-a118-c4a14fe9446e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:39:59.219860 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f89ad5e1-acdd-4caa-8c8f-b0c123905cb2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:59.249450 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f89ad5e1-acdd-4caa-8c8f-b0c123905cb2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:59.268122 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f89ad5e1-acdd-4caa-8c8f-b0c123905cb2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:59.269819 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f89ad5e1-acdd-4caa-8c8f-b0c123905cb2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1407 microversion: 2.20 time: 1.657024 Jan 15 02:39:59.283384 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 31/66] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:39:57 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1407 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:39:59.948017 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c416bc5a-47a3-488c-a118-c4a14fe9446e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:39:59.972846 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c416bc5a-47a3-488c-a118-c4a14fe9446e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1322 microversion: 2.1 time: 1.555426 Jan 15 02:39:59.974247 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 36/67] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:39:58 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1322 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:00.032201 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-bf96fa14-9e53-41c5-b7d0-3efcabe668c9 req-7c3c7ef4-1dee-4b4f-be7d-ef2eee98e188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6057534-a522-4ba4-ac63-0082adffe0fe", "tag": "19815834-163a-484c-af01-9e39e7f652c9"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:00.047676 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:40:00.047676 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:40:00.088662 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-bf96fa14-9e53-41c5-b7d0-3efcabe668c9 req-7c3c7ef4-1dee-4b4f-be7d-ef2eee98e188 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:00.089120 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-bf96fa14-9e53-41c5-b7d0-3efcabe668c9 req-7c3c7ef4-1dee-4b4f-be7d-ef2eee98e188 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:00.145702 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-bf96fa14-9e53-41c5-b7d0-3efcabe668c9 req-7c3c7ef4-1dee-4b4f-be7d-ef2eee98e188 service nova] Creating event network-changed:19815834-163a-484c-af01-9e39e7f652c9 for instance f6057534-a522-4ba4-ac63-0082adffe0fe on hv-cinder-76330 Jan 15 02:40:00.159352 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-bf96fa14-9e53-41c5-b7d0-3efcabe668c9 req-7c3c7ef4-1dee-4b4f-be7d-ef2eee98e188 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146436 Jan 15 02:40:00.160045 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 32/68] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:40:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:40:00.297269 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-dcb12c87-ef0f-4a67-bf75-38df37bd0c65 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:00.298069 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-dcb12c87-ef0f-4a67-bf75-38df37bd0c65 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:00.320308 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dcb12c87-ef0f-4a67-bf75-38df37bd0c65 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:00.320817 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dcb12c87-ef0f-4a67-bf75-38df37bd0c65 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:00.321778 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dcb12c87-ef0f-4a67-bf75-38df37bd0c65 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:00.322274 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dcb12c87-ef0f-4a67-bf75-38df37bd0c65 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:01.005599 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-89fc22d2-e593-49ee-a110-de1dacd96dc0 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d93718f5-05e0-4c71-af37-3acbe635ce04"}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:01.007090 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-89fc22d2-e593-49ee-a110-de1dacd96dc0 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:01.040400 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-89fc22d2-e593-49ee-a110-de1dacd96dc0 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:01.041872 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-89fc22d2-e593-49ee-a110-de1dacd96dc0 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:01.043600 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-89fc22d2-e593-49ee-a110-de1dacd96dc0 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:01.044747 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-89fc22d2-e593-49ee-a110-de1dacd96dc0 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:02.176863 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-89fc22d2-e593-49ee-a110-de1dacd96dc0 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "POST /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.189770 Jan 15 02:40:02.177920 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 33/69] 10.222.0.37 () {60 vars in 1313 bytes} [Fri Jan 15 02:40:00 2021] POST /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f/os-volume_attachments => generated 194 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:40:02.209146 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b3a6fe9e-763b-4169-989e-731cc3c4ab5d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:02.211299 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b3a6fe9e-763b-4169-989e-731cc3c4ab5d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:02.230450 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b3a6fe9e-763b-4169-989e-731cc3c4ab5d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:02.234413 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b3a6fe9e-763b-4169-989e-731cc3c4ab5d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:02.235733 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b3a6fe9e-763b-4169-989e-731cc3c4ab5d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:02.237170 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b3a6fe9e-763b-4169-989e-731cc3c4ab5d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:02.723836 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b3a6fe9e-763b-4169-989e-731cc3c4ab5d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:02.747734 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b3a6fe9e-763b-4169-989e-731cc3c4ab5d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1322 microversion: 2.1 time: 0.566927 Jan 15 02:40:02.750720 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 34/70] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:02 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1322 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:02.772483 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-136ef23e-b061-4b13-9f57-9662946af84b req-469b9905-93ee-4424-8ffb-72fb3f8660cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8a86e56-4ee0-4098-98bb-7deac49ba1aa", "tag": "a3bc182a-ab0e-4f1a-9e0f-958740ed4222"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:02.796164 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:40:02.796164 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:40:02.821634 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-136ef23e-b061-4b13-9f57-9662946af84b req-469b9905-93ee-4424-8ffb-72fb3f8660cb service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:02.837177 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-136ef23e-b061-4b13-9f57-9662946af84b req-469b9905-93ee-4424-8ffb-72fb3f8660cb service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:02.873916 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-136ef23e-b061-4b13-9f57-9662946af84b req-469b9905-93ee-4424-8ffb-72fb3f8660cb service nova] Creating event network-changed:a3bc182a-ab0e-4f1a-9e0f-958740ed4222 for instance a8a86e56-4ee0-4098-98bb-7deac49ba1aa on hv-cinder-76330 Jan 15 02:40:02.886822 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-136ef23e-b061-4b13-9f57-9662946af84b req-469b9905-93ee-4424-8ffb-72fb3f8660cb service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134462 Jan 15 02:40:02.888084 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 35/71] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:40:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:40:03.289569 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-dcb12c87-ef0f-4a67-bf75-38df37bd0c65 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:03.328806 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-dcb12c87-ef0f-4a67-bf75-38df37bd0c65 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:03.346846 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-dcb12c87-ef0f-4a67-bf75-38df37bd0c65 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:03.348445 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-dcb12c87-ef0f-4a67-bf75-38df37bd0c65 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1407 microversion: 2.20 time: 3.061935 Jan 15 02:40:03.354173 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 37/72] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:40:00 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1407 bytes in 3069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:40:03.791237 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a8729026-ed7c-467c-92b3-82cb180828e9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:03.796484 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a8729026-ed7c-467c-92b3-82cb180828e9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:03.824554 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a8729026-ed7c-467c-92b3-82cb180828e9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:03.826452 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a8729026-ed7c-467c-92b3-82cb180828e9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:03.829983 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a8729026-ed7c-467c-92b3-82cb180828e9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:03.831663 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a8729026-ed7c-467c-92b3-82cb180828e9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:04.386784 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-06ac0286-c89f-41b1-bb50-01b95b87f03e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:04.393891 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-06ac0286-c89f-41b1-bb50-01b95b87f03e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:04.421953 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-06ac0286-c89f-41b1-bb50-01b95b87f03e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:04.425979 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-06ac0286-c89f-41b1-bb50-01b95b87f03e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:04.428464 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-06ac0286-c89f-41b1-bb50-01b95b87f03e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:04.429379 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-06ac0286-c89f-41b1-bb50-01b95b87f03e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:04.473425 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a8729026-ed7c-467c-92b3-82cb180828e9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:04.487293 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a8729026-ed7c-467c-92b3-82cb180828e9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1322 microversion: 2.1 time: 0.722701 Jan 15 02:40:04.500271 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 36/73] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:03 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1322 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:05.545503 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e70a0bc3-6a91-4a44-b49c-7ec06650a570 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:05.550391 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e70a0bc3-6a91-4a44-b49c-7ec06650a570 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:05.579858 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e70a0bc3-6a91-4a44-b49c-7ec06650a570 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:05.588430 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e70a0bc3-6a91-4a44-b49c-7ec06650a570 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:05.594034 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e70a0bc3-6a91-4a44-b49c-7ec06650a570 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:05.595551 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e70a0bc3-6a91-4a44-b49c-7ec06650a570 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:05.662518 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-06ac0286-c89f-41b1-bb50-01b95b87f03e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:05.728272 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-06ac0286-c89f-41b1-bb50-01b95b87f03e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:05.766791 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-06ac0286-c89f-41b1-bb50-01b95b87f03e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:05.768890 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-06ac0286-c89f-41b1-bb50-01b95b87f03e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1407 microversion: 2.20 time: 1.394017 Jan 15 02:40:05.770051 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 38/74] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:40:04 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1407 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:40:06.097722 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e70a0bc3-6a91-4a44-b49c-7ec06650a570 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:06.117046 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e70a0bc3-6a91-4a44-b49c-7ec06650a570 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1322 microversion: 2.1 time: 0.612604 Jan 15 02:40:06.134656 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 37/75] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:05 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1322 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:06.403690 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-6a839a9a-d917-4ba7-a59b-ea00d79df319 req-ca5c5135-99ea-4427-9a9c-1333d9a4891b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6057534-a522-4ba4-ac63-0082adffe0fe", "name": "network-vif-plugged", "status": "completed", "tag": "19815834-163a-484c-af01-9e39e7f652c9"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:06.425605 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:40:06.425605 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:40:06.449257 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-6a839a9a-d917-4ba7-a59b-ea00d79df319 req-ca5c5135-99ea-4427-9a9c-1333d9a4891b service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:06.452463 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-6a839a9a-d917-4ba7-a59b-ea00d79df319 req-ca5c5135-99ea-4427-9a9c-1333d9a4891b service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:06.507481 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-6a839a9a-d917-4ba7-a59b-ea00d79df319 req-ca5c5135-99ea-4427-9a9c-1333d9a4891b service nova] Creating event network-vif-plugged:19815834-163a-484c-af01-9e39e7f652c9 for instance f6057534-a522-4ba4-ac63-0082adffe0fe on hv-cinder-76330 Jan 15 02:40:06.520685 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-6a839a9a-d917-4ba7-a59b-ea00d79df319 req-ca5c5135-99ea-4427-9a9c-1333d9a4891b service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136609 Jan 15 02:40:06.527663 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 39/76] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:40:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:40:06.811346 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-be774c0d-429f-4c33-bfd1-7e82cbec269b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:06.812195 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-be774c0d-429f-4c33-bfd1-7e82cbec269b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:06.837590 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-be774c0d-429f-4c33-bfd1-7e82cbec269b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:06.841598 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-be774c0d-429f-4c33-bfd1-7e82cbec269b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:06.842740 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-be774c0d-429f-4c33-bfd1-7e82cbec269b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:06.844994 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-be774c0d-429f-4c33-bfd1-7e82cbec269b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:07.180147 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-71eafdeb-4437-478e-9ca6-78c6566c6f5a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:07.183740 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-71eafdeb-4437-478e-9ca6-78c6566c6f5a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:07.222413 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-71eafdeb-4437-478e-9ca6-78c6566c6f5a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:07.223773 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-71eafdeb-4437-478e-9ca6-78c6566c6f5a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:07.226603 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-71eafdeb-4437-478e-9ca6-78c6566c6f5a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:07.229967 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-71eafdeb-4437-478e-9ca6-78c6566c6f5a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:07.517426 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-be774c0d-429f-4c33-bfd1-7e82cbec269b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:07.569198 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-be774c0d-429f-4c33-bfd1-7e82cbec269b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:07.588973 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-be774c0d-429f-4c33-bfd1-7e82cbec269b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:07.592619 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-be774c0d-429f-4c33-bfd1-7e82cbec269b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1407 microversion: 2.20 time: 0.791195 Jan 15 02:40:07.595690 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 38/77] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:40:06 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1407 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:40:07.905017 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-71eafdeb-4437-478e-9ca6-78c6566c6f5a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:07.922947 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-71eafdeb-4437-478e-9ca6-78c6566c6f5a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1322 microversion: 2.1 time: 0.785793 Jan 15 02:40:07.924037 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 40/78] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:07 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1322 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:40:08.656903 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-db8f57eb-d74d-4cf0-8b30-f02b082b4333 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:08.657811 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-db8f57eb-d74d-4cf0-8b30-f02b082b4333 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:08.666893 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-db8f57eb-d74d-4cf0-8b30-f02b082b4333 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:08.667526 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-db8f57eb-d74d-4cf0-8b30-f02b082b4333 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:08.668536 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-db8f57eb-d74d-4cf0-8b30-f02b082b4333 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:08.669706 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-db8f57eb-d74d-4cf0-8b30-f02b082b4333 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:08.976760 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7f95afa3-321a-4daa-a937-00332f20add1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:08.978010 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-7f95afa3-321a-4daa-a937-00332f20add1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:09.007947 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7f95afa3-321a-4daa-a937-00332f20add1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:09.008867 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7f95afa3-321a-4daa-a937-00332f20add1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:09.010439 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7f95afa3-321a-4daa-a937-00332f20add1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:09.011339 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7f95afa3-321a-4daa-a937-00332f20add1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:09.097803 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-db8f57eb-d74d-4cf0-8b30-f02b082b4333 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:09.114588 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-db8f57eb-d74d-4cf0-8b30-f02b082b4333 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:09.123178 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-db8f57eb-d74d-4cf0-8b30-f02b082b4333 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:09.124874 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-db8f57eb-d74d-4cf0-8b30-f02b082b4333 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1407 microversion: 2.20 time: 0.500142 Jan 15 02:40:09.136772 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 39/79] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:40:08 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1407 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:40:09.603382 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-7f95afa3-321a-4daa-a937-00332f20add1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:09.615937 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-7f95afa3-321a-4daa-a937-00332f20add1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1322 microversion: 2.1 time: 0.678389 Jan 15 02:40:09.617436 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 41/80] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:08 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1322 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:10.170861 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4193f59e-bc56-4baa-9eba-a22feeb48e8d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:10.172375 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4193f59e-bc56-4baa-9eba-a22feeb48e8d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:10.194164 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4193f59e-bc56-4baa-9eba-a22feeb48e8d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:10.195518 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4193f59e-bc56-4baa-9eba-a22feeb48e8d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:10.197720 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4193f59e-bc56-4baa-9eba-a22feeb48e8d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:10.198992 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4193f59e-bc56-4baa-9eba-a22feeb48e8d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:10.655507 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4193f59e-bc56-4baa-9eba-a22feeb48e8d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:10.667623 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e9ac0284-cd9d-446f-b57e-84a275054a7d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:10.669710 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e9ac0284-cd9d-446f-b57e-84a275054a7d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:10.689141 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4193f59e-bc56-4baa-9eba-a22feeb48e8d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:10.691254 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e9ac0284-cd9d-446f-b57e-84a275054a7d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:10.692301 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e9ac0284-cd9d-446f-b57e-84a275054a7d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:10.694257 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e9ac0284-cd9d-446f-b57e-84a275054a7d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:10.695306 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e9ac0284-cd9d-446f-b57e-84a275054a7d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:10.705269 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4193f59e-bc56-4baa-9eba-a22feeb48e8d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:10.707475 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4193f59e-bc56-4baa-9eba-a22feeb48e8d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1407 microversion: 2.20 time: 0.565024 Jan 15 02:40:10.717824 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 40/81] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:40:10 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1407 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:40:11.584545 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e9ac0284-cd9d-446f-b57e-84a275054a7d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:11.601922 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e9ac0284-cd9d-446f-b57e-84a275054a7d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1322 microversion: 2.1 time: 0.956491 Jan 15 02:40:11.614820 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 42/82] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:10 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1322 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:11.772616 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-58908719-125f-4597-9d38-d57530584fb6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:11.776129 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-58908719-125f-4597-9d38-d57530584fb6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:11.819712 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-58908719-125f-4597-9d38-d57530584fb6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:11.821879 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-58908719-125f-4597-9d38-d57530584fb6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:11.823847 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-58908719-125f-4597-9d38-d57530584fb6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:11.826814 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-58908719-125f-4597-9d38-d57530584fb6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:12.390526 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-58908719-125f-4597-9d38-d57530584fb6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:12.445285 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-58908719-125f-4597-9d38-d57530584fb6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:12.484039 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-58908719-125f-4597-9d38-d57530584fb6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:12.489741 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-58908719-125f-4597-9d38-d57530584fb6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1407 microversion: 2.20 time: 0.755978 Jan 15 02:40:12.492794 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 41/83] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:40:11 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1407 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:40:12.634505 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-24ff9498-b9bf-4bdd-9c2c-1c1b3875cef0 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:12.636568 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-24ff9498-b9bf-4bdd-9c2c-1c1b3875cef0 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:12.653759 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-24ff9498-b9bf-4bdd-9c2c-1c1b3875cef0 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:12.655078 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-24ff9498-b9bf-4bdd-9c2c-1c1b3875cef0 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:12.656966 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-24ff9498-b9bf-4bdd-9c2c-1c1b3875cef0 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:12.658137 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-24ff9498-b9bf-4bdd-9c2c-1c1b3875cef0 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:13.113958 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-24ff9498-b9bf-4bdd-9c2c-1c1b3875cef0 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:13.168463 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-24ff9498-b9bf-4bdd-9c2c-1c1b3875cef0 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1516 microversion: 2.1 time: 0.549824 Jan 15 02:40:13.170822 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 43/84] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:12 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1516 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:40:13.196955 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-940978de-0093-4521-8db2-77440013793b tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:13.198394 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-940978de-0093-4521-8db2-77440013793b tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:13.207732 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-940978de-0093-4521-8db2-77440013793b tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:13.208461 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-940978de-0093-4521-8db2-77440013793b tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:13.209578 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-940978de-0093-4521-8db2-77440013793b tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:13.210238 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-940978de-0093-4521-8db2-77440013793b tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:13.288855 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.objects.instance [None req-940978de-0093-4521-8db2-77440013793b tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lazy-loading 'flavor' on Instance uuid f6057534-a522-4ba4-ac63-0082adffe0fe {{(pid=94111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Jan 15 02:40:13.569647 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b878529a-6d31-4903-9151-af51cd3473b7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:13.570885 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b878529a-6d31-4903-9151-af51cd3473b7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:13.607981 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b878529a-6d31-4903-9151-af51cd3473b7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:13.608939 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b878529a-6d31-4903-9151-af51cd3473b7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:13.619074 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b878529a-6d31-4903-9151-af51cd3473b7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:13.619949 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b878529a-6d31-4903-9151-af51cd3473b7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:13.635038 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-940978de-0093-4521-8db2-77440013793b tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "POST /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe/action" status: 200 len: 32 microversion: 2.1 time: 0.450593 Jan 15 02:40:13.640742 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 42/85] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:40:13 2021] POST /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe/action => generated 32 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 02:40:13.653312 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b05bc921-b9f9-4428-b117-d15edc568a9a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:13.654098 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b05bc921-b9f9-4428-b117-d15edc568a9a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:13.677469 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b05bc921-b9f9-4428-b117-d15edc568a9a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:13.677987 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b05bc921-b9f9-4428-b117-d15edc568a9a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:13.678862 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b05bc921-b9f9-4428-b117-d15edc568a9a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:13.679348 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b05bc921-b9f9-4428-b117-d15edc568a9a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:14.195802 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b05bc921-b9f9-4428-b117-d15edc568a9a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:14.220753 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b05bc921-b9f9-4428-b117-d15edc568a9a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1522 microversion: 2.1 time: 0.578161 Jan 15 02:40:14.234802 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 43/86] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:13 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1522 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:40:14.335689 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a350dc88-e2ac-45d5-af7d-318bae3d464a tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:14.346761 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a350dc88-e2ac-45d5-af7d-318bae3d464a tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:14.364441 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a350dc88-e2ac-45d5-af7d-318bae3d464a tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:14.380888 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a350dc88-e2ac-45d5-af7d-318bae3d464a tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:14.382156 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a350dc88-e2ac-45d5-af7d-318bae3d464a tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:14.387581 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a350dc88-e2ac-45d5-af7d-318bae3d464a tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:14.653664 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a350dc88-e2ac-45d5-af7d-318bae3d464a tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Going to try to terminate instance {{(pid=94111) delete /opt/stack/nova/nova/compute/api.py:2535}} Jan 15 02:40:14.656979 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b878529a-6d31-4903-9151-af51cd3473b7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:14.698655 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b878529a-6d31-4903-9151-af51cd3473b7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:14.720427 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b878529a-6d31-4903-9151-af51cd3473b7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:14.721913 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b878529a-6d31-4903-9151-af51cd3473b7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1407 microversion: 2.20 time: 1.192376 Jan 15 02:40:14.722714 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 44/87] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:40:13 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1407 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:40:14.753286 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-e5e70dfa-bb09-4c42-89eb-6ee1f5023feb req-c78daa2b-aa87-4667-9ad9-d958143c15b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a86e56-4ee0-4098-98bb-7deac49ba1aa", "name": "network-vif-plugged", "status": "completed", "tag": "a3bc182a-ab0e-4f1a-9e0f-958740ed4222"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:14.770979 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:40:14.770979 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:40:14.797986 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-e5e70dfa-bb09-4c42-89eb-6ee1f5023feb req-c78daa2b-aa87-4667-9ad9-d958143c15b7 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:14.797986 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-e5e70dfa-bb09-4c42-89eb-6ee1f5023feb req-c78daa2b-aa87-4667-9ad9-d958143c15b7 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:14.869211 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-e5e70dfa-bb09-4c42-89eb-6ee1f5023feb req-c78daa2b-aa87-4667-9ad9-d958143c15b7 service nova] Creating event network-vif-plugged:a3bc182a-ab0e-4f1a-9e0f-958740ed4222 for instance a8a86e56-4ee0-4098-98bb-7deac49ba1aa on hv-cinder-76330 Jan 15 02:40:14.882156 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-e5e70dfa-bb09-4c42-89eb-6ee1f5023feb req-c78daa2b-aa87-4667-9ad9-d958143c15b7 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157192 Jan 15 02:40:14.884624 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 45/88] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:40:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:40:14.989161 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a350dc88-e2ac-45d5-af7d-318bae3d464a tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "DELETE /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 204 len: 0 microversion: 2.1 time: 0.660472 Jan 15 02:40:14.997417 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 44/89] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:40:14 2021] DELETE /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 0 bytes in 670 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 02:40:15.046323 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-30dced51-5d24-4ff2-b3fc-1e6158451ecd tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:15.051341 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-30dced51-5d24-4ff2-b3fc-1e6158451ecd tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:15.086932 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-30dced51-5d24-4ff2-b3fc-1e6158451ecd tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:15.087858 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-30dced51-5d24-4ff2-b3fc-1e6158451ecd tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:15.089564 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-30dced51-5d24-4ff2-b3fc-1e6158451ecd tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:15.102665 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-30dced51-5d24-4ff2-b3fc-1e6158451ecd tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:15.297827 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c3a3bf9e-c669-4f99-b16f-97acff8254aa tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:15.303310 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c3a3bf9e-c669-4f99-b16f-97acff8254aa tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:15.329805 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c3a3bf9e-c669-4f99-b16f-97acff8254aa tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:15.330321 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c3a3bf9e-c669-4f99-b16f-97acff8254aa tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:15.331203 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c3a3bf9e-c669-4f99-b16f-97acff8254aa tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:15.331708 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c3a3bf9e-c669-4f99-b16f-97acff8254aa tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:15.969692 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-30dced51-5d24-4ff2-b3fc-1e6158451ecd tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6681e7cd24a94e4b99434f9c3c04a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea5b3764f4a068aadc567e576c3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:15.993185 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-30dced51-5d24-4ff2-b3fc-1e6158451ecd tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 200 len: 1552 microversion: 2.1 time: 0.990744 Jan 15 02:40:16.004871 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 46/90] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:14 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 1552 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:16.029456 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c2fe07db-f981-40fe-b568-7cd977757e40 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:16.030736 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c2fe07db-f981-40fe-b568-7cd977757e40 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:16.047544 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c2fe07db-f981-40fe-b568-7cd977757e40 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:16.048739 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c2fe07db-f981-40fe-b568-7cd977757e40 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:16.050097 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c2fe07db-f981-40fe-b568-7cd977757e40 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:16.051013 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c2fe07db-f981-40fe-b568-7cd977757e40 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:16.382007 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c3a3bf9e-c669-4f99-b16f-97acff8254aa tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:16.414346 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c3a3bf9e-c669-4f99-b16f-97acff8254aa tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1522 microversion: 2.1 time: 1.175277 Jan 15 02:40:16.415366 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 45/91] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:15 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1522 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:16.596616 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c2fe07db-f981-40fe-b568-7cd977757e40 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:16.634363 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c2fe07db-f981-40fe-b568-7cd977757e40 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:16.654737 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c2fe07db-f981-40fe-b568-7cd977757e40 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:16.657239 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c2fe07db-f981-40fe-b568-7cd977757e40 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1407 microversion: 2.20 time: 0.650013 Jan 15 02:40:16.659548 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 47/92] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:40:16 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1407 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:40:17.039619 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b02f85b5-9f38-47b7-81f8-8da8608e4d90 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:17.041737 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b02f85b5-9f38-47b7-81f8-8da8608e4d90 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:17.052702 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b02f85b5-9f38-47b7-81f8-8da8608e4d90 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:17.053527 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b02f85b5-9f38-47b7-81f8-8da8608e4d90 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:17.054952 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b02f85b5-9f38-47b7-81f8-8da8608e4d90 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:17.055584 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b02f85b5-9f38-47b7-81f8-8da8608e4d90 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:17.462554 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-490f1ab1-4439-44c5-b7e9-9baf7192be12 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:17.464356 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-490f1ab1-4439-44c5-b7e9-9baf7192be12 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:17.485846 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-490f1ab1-4439-44c5-b7e9-9baf7192be12 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:17.487139 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-490f1ab1-4439-44c5-b7e9-9baf7192be12 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:17.489262 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-490f1ab1-4439-44c5-b7e9-9baf7192be12 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:17.490590 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-490f1ab1-4439-44c5-b7e9-9baf7192be12 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:17.608072 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b02f85b5-9f38-47b7-81f8-8da8608e4d90 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6681e7cd24a94e4b99434f9c3c04a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea5b3764f4a068aadc567e576c3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:17.647941 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b02f85b5-9f38-47b7-81f8-8da8608e4d90 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 200 len: 1552 microversion: 2.1 time: 0.624158 Jan 15 02:40:17.658511 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 46/93] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:17 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 1552 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:17.753125 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-12d797d5-b954-46b6-9a9f-329daa413214 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:17.763123 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-12d797d5-b954-46b6-9a9f-329daa413214 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:17.776207 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-12d797d5-b954-46b6-9a9f-329daa413214 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:17.782998 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-12d797d5-b954-46b6-9a9f-329daa413214 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:17.784164 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-12d797d5-b954-46b6-9a9f-329daa413214 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:17.784897 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-12d797d5-b954-46b6-9a9f-329daa413214 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:18.265875 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-490f1ab1-4439-44c5-b7e9-9baf7192be12 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:18.326734 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-490f1ab1-4439-44c5-b7e9-9baf7192be12 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1522 microversion: 2.1 time: 0.893363 Jan 15 02:40:18.328125 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 48/94] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:17 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1522 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:18.347700 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-12d797d5-b954-46b6-9a9f-329daa413214 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:18.368022 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-12d797d5-b954-46b6-9a9f-329daa413214 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:18.377862 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-12d797d5-b954-46b6-9a9f-329daa413214 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:18.379467 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-12d797d5-b954-46b6-9a9f-329daa413214 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1407 microversion: 2.20 time: 0.692311 Jan 15 02:40:18.380632 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 47/95] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:40:17 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1407 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:40:18.698800 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-899215ab-534b-48c1-9903-3fae1808d3c1 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:18.700661 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-899215ab-534b-48c1-9903-3fae1808d3c1 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:18.734400 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-899215ab-534b-48c1-9903-3fae1808d3c1 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:18.740876 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-899215ab-534b-48c1-9903-3fae1808d3c1 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:18.758421 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-899215ab-534b-48c1-9903-3fae1808d3c1 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:18.759330 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-899215ab-534b-48c1-9903-3fae1808d3c1 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:19.353794 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1e3763e9-7f7a-4647-beaa-2e546395a68a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:19.354448 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1e3763e9-7f7a-4647-beaa-2e546395a68a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:19.370927 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1e3763e9-7f7a-4647-beaa-2e546395a68a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:19.372241 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1e3763e9-7f7a-4647-beaa-2e546395a68a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:19.373783 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1e3763e9-7f7a-4647-beaa-2e546395a68a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:19.374468 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1e3763e9-7f7a-4647-beaa-2e546395a68a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:19.698899 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-899215ab-534b-48c1-9903-3fae1808d3c1 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6681e7cd24a94e4b99434f9c3c04a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea5b3764f4a068aadc567e576c3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:19.724554 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-899215ab-534b-48c1-9903-3fae1808d3c1 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 200 len: 1552 microversion: 2.1 time: 1.057833 Jan 15 02:40:19.726554 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 49/96] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:18 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 1552 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:19.748601 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2f7f7bf9-9a4a-4cfd-b746-0270e2c7ac91 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:19.750422 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2f7f7bf9-9a4a-4cfd-b746-0270e2c7ac91 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:19.771051 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2f7f7bf9-9a4a-4cfd-b746-0270e2c7ac91 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:19.772853 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2f7f7bf9-9a4a-4cfd-b746-0270e2c7ac91 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:19.774817 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2f7f7bf9-9a4a-4cfd-b746-0270e2c7ac91 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:19.776036 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2f7f7bf9-9a4a-4cfd-b746-0270e2c7ac91 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:20.008570 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1e3763e9-7f7a-4647-beaa-2e546395a68a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:20.031652 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1e3763e9-7f7a-4647-beaa-2e546395a68a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1522 microversion: 2.1 time: 0.688671 Jan 15 02:40:20.033473 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 48/97] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:19 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1522 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:20.619545 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-2f7f7bf9-9a4a-4cfd-b746-0270e2c7ac91 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:20.674211 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-2f7f7bf9-9a4a-4cfd-b746-0270e2c7ac91 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:20.688991 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-2f7f7bf9-9a4a-4cfd-b746-0270e2c7ac91 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:20.693752 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2f7f7bf9-9a4a-4cfd-b746-0270e2c7ac91 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1600 microversion: 2.20 time: 0.965231 Jan 15 02:40:20.694626 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 50/98] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:40:19 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1600 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:40:20.726800 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d35f59ae-63da-457c-a8cf-928cad93baf5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:20.729430 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d35f59ae-63da-457c-a8cf-928cad93baf5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:20.742159 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d35f59ae-63da-457c-a8cf-928cad93baf5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:20.742786 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d35f59ae-63da-457c-a8cf-928cad93baf5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:20.744178 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d35f59ae-63da-457c-a8cf-928cad93baf5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:20.744783 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d35f59ae-63da-457c-a8cf-928cad93baf5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:20.761471 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a793b33a-f7ac-4d65-a15e-f6cdcd75267a tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:20.770735 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a793b33a-f7ac-4d65-a15e-f6cdcd75267a tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:20.797748 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a793b33a-f7ac-4d65-a15e-f6cdcd75267a tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:20.798646 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a793b33a-f7ac-4d65-a15e-f6cdcd75267a tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:20.799766 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a793b33a-f7ac-4d65-a15e-f6cdcd75267a tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:20.800460 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a793b33a-f7ac-4d65-a15e-f6cdcd75267a tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:21.091326 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d35f59ae-63da-457c-a8cf-928cad93baf5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.380888 Jan 15 02:40:21.099113 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 49/99] 10.222.0.37 () {60 vars in 1306 bytes} [Fri Jan 15 02:40:20 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/os-interface => generated 285 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:40:21.113118 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d413c88a-79c6-44b5-a572-f78d1344074a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:21.114444 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d413c88a-79c6-44b5-a572-f78d1344074a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:21.125143 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d413c88a-79c6-44b5-a572-f78d1344074a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:21.125664 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d413c88a-79c6-44b5-a572-f78d1344074a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:21.126552 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d413c88a-79c6-44b5-a572-f78d1344074a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:21.127052 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d413c88a-79c6-44b5-a572-f78d1344074a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:21.215952 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a793b33a-f7ac-4d65-a15e-f6cdcd75267a tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6681e7cd24a94e4b99434f9c3c04a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea5b3764f4a068aadc567e576c3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:21.247463 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a793b33a-f7ac-4d65-a15e-f6cdcd75267a tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 200 len: 1510 microversion: 2.1 time: 0.495304 Jan 15 02:40:21.251760 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 51/100] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:20 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 1510 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:40:21.392807 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-b1d6c397-a684-4540-805f-3314b5d8e65c req-b3f9b627-ec07-42c9-96ce-c9699fa64de6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67ce428a-3f61-43ae-98d8-8b18cd00be8f", "name": "network-vif-deleted", "tag": "02a8485a-e56a-4105-ad1a-f54c75e86b46"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:21.420419 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:40:21.420419 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:40:21.441562 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-b1d6c397-a684-4540-805f-3314b5d8e65c req-b3f9b627-ec07-42c9-96ce-c9699fa64de6 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:21.442474 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-b1d6c397-a684-4540-805f-3314b5d8e65c req-b3f9b627-ec07-42c9-96ce-c9699fa64de6 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:21.462776 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-b1d6c397-a684-4540-805f-3314b5d8e65c req-b3f9b627-ec07-42c9-96ce-c9699fa64de6 service nova] Creating event network-vif-deleted:02a8485a-e56a-4105-ad1a-f54c75e86b46 for instance 67ce428a-3f61-43ae-98d8-8b18cd00be8f on hv-cinder-76330 Jan 15 02:40:21.469268 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-b1d6c397-a684-4540-805f-3314b5d8e65c req-b3f9b627-ec07-42c9-96ce-c9699fa64de6 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086314 Jan 15 02:40:21.470708 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 52/101] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:40:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:40:22.264055 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d413c88a-79c6-44b5-a572-f78d1344074a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:22.277998 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d413c88a-79c6-44b5-a572-f78d1344074a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1522 microversion: 2.1 time: 1.176964 Jan 15 02:40:22.289434 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 50/102] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:21 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1522 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:22.300447 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-64cfbaef-0ad9-4aeb-bf57-a089e3868969 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:22.317970 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-64cfbaef-0ad9-4aeb-bf57-a089e3868969 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:22.347264 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-64cfbaef-0ad9-4aeb-bf57-a089e3868969 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:22.348386 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-64cfbaef-0ad9-4aeb-bf57-a089e3868969 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:22.350500 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-64cfbaef-0ad9-4aeb-bf57-a089e3868969 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:22.352034 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-64cfbaef-0ad9-4aeb-bf57-a089e3868969 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:22.687549 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-64cfbaef-0ad9-4aeb-bf57-a089e3868969 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6681e7cd24a94e4b99434f9c3c04a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea5b3764f4a068aadc567e576c3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:22.710793 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-64cfbaef-0ad9-4aeb-bf57-a089e3868969 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 200 len: 1345 microversion: 2.1 time: 0.447876 Jan 15 02:40:22.721630 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 53/103] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:22 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 1345 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:23.332225 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ea2f3d1f-8337-49fc-91dc-7145dd5d8265 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:23.333774 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ea2f3d1f-8337-49fc-91dc-7145dd5d8265 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:23.377243 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ea2f3d1f-8337-49fc-91dc-7145dd5d8265 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:23.378203 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ea2f3d1f-8337-49fc-91dc-7145dd5d8265 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:23.381367 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ea2f3d1f-8337-49fc-91dc-7145dd5d8265 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:23.382300 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ea2f3d1f-8337-49fc-91dc-7145dd5d8265 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:23.750060 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-8bd481e5-1628-43f3-b747-10b9930046b6 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:23.750947 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8bd481e5-1628-43f3-b747-10b9930046b6 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:23.775064 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8bd481e5-1628-43f3-b747-10b9930046b6 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:23.775961 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8bd481e5-1628-43f3-b747-10b9930046b6 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:23.783302 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8bd481e5-1628-43f3-b747-10b9930046b6 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:23.784906 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8bd481e5-1628-43f3-b747-10b9930046b6 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:23.898254 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8bd481e5-1628-43f3-b747-10b9930046b6 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:23.899121 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8bd481e5-1628-43f3-b747-10b9930046b6 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:23.899826 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.objects.instance [None req-8bd481e5-1628-43f3-b747-10b9930046b6 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lazy-loading 'fault' on Instance uuid 67ce428a-3f61-43ae-98d8-8b18cd00be8f {{(pid=94112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Jan 15 02:40:23.982920 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-8bd481e5-1628-43f3-b747-10b9930046b6 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6681e7cd24a94e4b99434f9c3c04a879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea5b3764f4a068aadc567e576c3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:23.994915 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-8bd481e5-1628-43f3-b747-10b9930046b6 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 200 len: 1350 microversion: 2.1 time: 0.264537 Jan 15 02:40:23.996583 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 54/104] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:23 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 1350 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:24.621665 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-ea2f3d1f-8337-49fc-91dc-7145dd5d8265 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:24.658081 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ea2f3d1f-8337-49fc-91dc-7145dd5d8265 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1522 microversion: 2.1 time: 1.364866 Jan 15 02:40:24.659007 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 51/105] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:23 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1522 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:25.059553 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-69b364a8-8d25-4ba8-9382-272f474568de tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:25.065805 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1e0147f7-01e5-44ff-9f79-24f1883b127e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:25.067424 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-69b364a8-8d25-4ba8-9382-272f474568de tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:25.068251 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1e0147f7-01e5-44ff-9f79-24f1883b127e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:25.079076 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1e0147f7-01e5-44ff-9f79-24f1883b127e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:25.079563 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1e0147f7-01e5-44ff-9f79-24f1883b127e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:25.080956 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1e0147f7-01e5-44ff-9f79-24f1883b127e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:25.082074 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1e0147f7-01e5-44ff-9f79-24f1883b127e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:25.116992 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-69b364a8-8d25-4ba8-9382-272f474568de tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:25.117883 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-69b364a8-8d25-4ba8-9382-272f474568de tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:25.119304 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-69b364a8-8d25-4ba8-9382-272f474568de tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:25.120140 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-69b364a8-8d25-4ba8-9382-272f474568de tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:25.248870 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1e0147f7-01e5-44ff-9f79-24f1883b127e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 14 microversion: 2.20 time: 0.198341 Jan 15 02:40:25.250182 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 52/106] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:40:25 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:25.273973 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-0be2cfb2-234c-4cd5-8e5b-b3c86d6105b3 req-f2cc9e8d-bbac-4a3c-8eb1-a02dc64384df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8a86e56-4ee0-4098-98bb-7deac49ba1aa", "tag": "a3bc182a-ab0e-4f1a-9e0f-958740ed4222"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:25.288710 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:40:25.288710 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:40:25.311503 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-0be2cfb2-234c-4cd5-8e5b-b3c86d6105b3 req-f2cc9e8d-bbac-4a3c-8eb1-a02dc64384df service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:25.316702 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-0be2cfb2-234c-4cd5-8e5b-b3c86d6105b3 req-f2cc9e8d-bbac-4a3c-8eb1-a02dc64384df service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:25.354874 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-0be2cfb2-234c-4cd5-8e5b-b3c86d6105b3 req-f2cc9e8d-bbac-4a3c-8eb1-a02dc64384df service nova] Creating event network-changed:a3bc182a-ab0e-4f1a-9e0f-958740ed4222 for instance a8a86e56-4ee0-4098-98bb-7deac49ba1aa on hv-cinder-76330 Jan 15 02:40:25.356907 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-69b364a8-8d25-4ba8-9382-272f474568de tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] HTTP exception thrown: Instance 67ce428a-3f61-43ae-98d8-8b18cd00be8f could not be found. Jan 15 02:40:25.360855 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-69b364a8-8d25-4ba8-9382-272f474568de tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Returning 404 to user: Instance 67ce428a-3f61-43ae-98d8-8b18cd00be8f could not be found. {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:40:25.364078 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-0be2cfb2-234c-4cd5-8e5b-b3c86d6105b3 req-f2cc9e8d-bbac-4a3c-8eb1-a02dc64384df service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112049 Jan 15 02:40:25.368239 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-69b364a8-8d25-4ba8-9382-272f474568de tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 404 len: 111 microversion: 2.1 time: 0.356599 Jan 15 02:40:25.370203 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 55/107] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:25 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 111 bytes in 360 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:40:25.371745 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 53/108] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:40:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:40:25.715832 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7bf817f3-70ad-45c3-9405-7e77ee7f9344 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:25.720568 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-7bf817f3-70ad-45c3-9405-7e77ee7f9344 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:25.754604 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7bf817f3-70ad-45c3-9405-7e77ee7f9344 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:25.756175 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7bf817f3-70ad-45c3-9405-7e77ee7f9344 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:25.758346 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7bf817f3-70ad-45c3-9405-7e77ee7f9344 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:25.768096 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7bf817f3-70ad-45c3-9405-7e77ee7f9344 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:26.287403 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-312db27b-5552-4275-8515-37322d0aa841 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:26.293586 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-312db27b-5552-4275-8515-37322d0aa841 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:26.329620 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-312db27b-5552-4275-8515-37322d0aa841 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:26.331015 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-312db27b-5552-4275-8515-37322d0aa841 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:26.333090 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-312db27b-5552-4275-8515-37322d0aa841 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:26.342497 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-312db27b-5552-4275-8515-37322d0aa841 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:26.587551 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-312db27b-5552-4275-8515-37322d0aa841 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 14 microversion: 2.20 time: 0.326322 Jan 15 02:40:26.588525 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 54/109] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:40:26 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 14 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:40:26.957918 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-7bf817f3-70ad-45c3-9405-7e77ee7f9344 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:26.987232 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-7bf817f3-70ad-45c3-9405-7e77ee7f9344 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1522 microversion: 2.1 time: 1.312016 Jan 15 02:40:27.003770 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 56/110] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:25 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1522 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:27.624020 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-63296aa4-c3ff-4c52-a621-cd8be82c3bc4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:27.627005 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-63296aa4-c3ff-4c52-a621-cd8be82c3bc4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:27.644353 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-63296aa4-c3ff-4c52-a621-cd8be82c3bc4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:27.645525 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-63296aa4-c3ff-4c52-a621-cd8be82c3bc4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:27.648546 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-63296aa4-c3ff-4c52-a621-cd8be82c3bc4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:27.649590 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-63296aa4-c3ff-4c52-a621-cd8be82c3bc4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:27.904553 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-63296aa4-c3ff-4c52-a621-cd8be82c3bc4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 14 microversion: 2.20 time: 0.303723 Jan 15 02:40:27.908379 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 55/111] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:40:27 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 14 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:28.052795 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-fb3cac4a-b4df-4b20-af0d-229fe433538a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:28.056205 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-fb3cac4a-b4df-4b20-af0d-229fe433538a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:28.084477 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fb3cac4a-b4df-4b20-af0d-229fe433538a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:28.085771 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fb3cac4a-b4df-4b20-af0d-229fe433538a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:28.087600 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fb3cac4a-b4df-4b20-af0d-229fe433538a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:28.088753 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fb3cac4a-b4df-4b20-af0d-229fe433538a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:28.466619 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-66543a39-4bfc-44c1-8343-5e6df3900b35 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:28.469742 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-66543a39-4bfc-44c1-8343-5e6df3900b35 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:28.488465 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-66543a39-4bfc-44c1-8343-5e6df3900b35 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:28.488987 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-66543a39-4bfc-44c1-8343-5e6df3900b35 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:28.489883 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-66543a39-4bfc-44c1-8343-5e6df3900b35 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:28.490391 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-66543a39-4bfc-44c1-8343-5e6df3900b35 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:28.614459 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-66543a39-4bfc-44c1-8343-5e6df3900b35 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] HTTP exception thrown: Instance 67ce428a-3f61-43ae-98d8-8b18cd00be8f could not be found. Jan 15 02:40:28.615148 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-66543a39-4bfc-44c1-8343-5e6df3900b35 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Returning 404 to user: Instance 67ce428a-3f61-43ae-98d8-8b18cd00be8f could not be found. {{(pid=94111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:40:28.616065 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-66543a39-4bfc-44c1-8343-5e6df3900b35 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "DELETE /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 404 len: 111 microversion: 2.1 time: 0.167014 Jan 15 02:40:28.616897 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 56/112] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:40:28 2021] DELETE /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:40:28.685908 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6f2f6d79-852e-4fd1-8b94-4fa062cf4a96 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:28.686763 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6f2f6d79-852e-4fd1-8b94-4fa062cf4a96 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] [instance: 67ce428a-3f61-43ae-98d8-8b18cd00be8f] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:28.726732 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6f2f6d79-852e-4fd1-8b94-4fa062cf4a96 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:28.727482 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6f2f6d79-852e-4fd1-8b94-4fa062cf4a96 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:28.731447 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6f2f6d79-852e-4fd1-8b94-4fa062cf4a96 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:28.732265 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6f2f6d79-852e-4fd1-8b94-4fa062cf4a96 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:28.814388 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-6f2f6d79-852e-4fd1-8b94-4fa062cf4a96 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] HTTP exception thrown: Instance 67ce428a-3f61-43ae-98d8-8b18cd00be8f could not be found. Jan 15 02:40:28.815264 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6f2f6d79-852e-4fd1-8b94-4fa062cf4a96 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] Returning 404 to user: Instance 67ce428a-3f61-43ae-98d8-8b18cd00be8f could not be found. {{(pid=94111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:40:28.816342 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6f2f6d79-852e-4fd1-8b94-4fa062cf4a96 tempest-DeleteServersTestJSON-1118338940 tempest-DeleteServersTestJSON-1118338940] 10.222.0.37 "GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f" status: 404 len: 111 microversion: 2.1 time: 0.171700 Jan 15 02:40:28.817350 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 57/113] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:28 2021] GET /compute/v2.1/servers/67ce428a-3f61-43ae-98d8-8b18cd00be8f => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:40:28.928618 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a66b7c61-66e0-4b83-846d-399b39875446 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:28.931800 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a66b7c61-66e0-4b83-846d-399b39875446 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:28.954534 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a66b7c61-66e0-4b83-846d-399b39875446 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:28.956282 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-fb3cac4a-b4df-4b20-af0d-229fe433538a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:28.956905 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a66b7c61-66e0-4b83-846d-399b39875446 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:28.958829 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a66b7c61-66e0-4b83-846d-399b39875446 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:28.959830 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a66b7c61-66e0-4b83-846d-399b39875446 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:28.976866 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-fb3cac4a-b4df-4b20-af0d-229fe433538a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1522 microversion: 2.1 time: 0.946631 Jan 15 02:40:28.978066 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 57/114] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:28 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1522 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:29.189819 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a66b7c61-66e0-4b83-846d-399b39875446 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 14 microversion: 2.20 time: 0.276803 Jan 15 02:40:29.190616 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 58/115] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:40:28 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 14 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:30.012822 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c6c83580-af4c-497c-874d-409f58174035 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:30.013785 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c6c83580-af4c-497c-874d-409f58174035 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:30.022363 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c6c83580-af4c-497c-874d-409f58174035 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:30.022980 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c6c83580-af4c-497c-874d-409f58174035 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:30.023938 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c6c83580-af4c-497c-874d-409f58174035 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:30.024515 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c6c83580-af4c-497c-874d-409f58174035 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:30.209849 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e908a079-70cd-422b-b6e7-9c32e92938a3 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:30.211394 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e908a079-70cd-422b-b6e7-9c32e92938a3 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:30.223253 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e908a079-70cd-422b-b6e7-9c32e92938a3 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:30.224111 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e908a079-70cd-422b-b6e7-9c32e92938a3 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:30.225817 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e908a079-70cd-422b-b6e7-9c32e92938a3 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:30.226488 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e908a079-70cd-422b-b6e7-9c32e92938a3 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:30.395635 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e908a079-70cd-422b-b6e7-9c32e92938a3 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 14 microversion: 2.20 time: 0.198008 Jan 15 02:40:30.399560 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 59/116] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:40:30 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:40:30.913714 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c6c83580-af4c-497c-874d-409f58174035 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:30.968966 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c6c83580-af4c-497c-874d-409f58174035 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1522 microversion: 2.1 time: 0.965763 Jan 15 02:40:30.972565 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 58/117] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:30 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1522 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:31.428391 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-939b46f6-cec3-4baf-88e7-80ee0113987a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:31.430419 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-939b46f6-cec3-4baf-88e7-80ee0113987a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:31.443592 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-939b46f6-cec3-4baf-88e7-80ee0113987a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:31.444627 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-939b46f6-cec3-4baf-88e7-80ee0113987a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:31.446223 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-939b46f6-cec3-4baf-88e7-80ee0113987a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:31.447057 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-939b46f6-cec3-4baf-88e7-80ee0113987a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:31.686224 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-939b46f6-cec3-4baf-88e7-80ee0113987a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 14 microversion: 2.20 time: 0.280132 Jan 15 02:40:31.687464 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 60/118] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:40:31 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 14 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:32.035764 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-77983f98-2927-47a6-af50-5fd13f70092f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:32.036939 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-77983f98-2927-47a6-af50-5fd13f70092f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:32.064374 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-77983f98-2927-47a6-af50-5fd13f70092f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:32.065144 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-77983f98-2927-47a6-af50-5fd13f70092f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:32.066571 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-77983f98-2927-47a6-af50-5fd13f70092f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:32.067626 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-77983f98-2927-47a6-af50-5fd13f70092f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:32.732085 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e94d1e16-e21e-44a2-867e-32656a0b024d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:32.734001 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e94d1e16-e21e-44a2-867e-32656a0b024d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:32.776047 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e94d1e16-e21e-44a2-867e-32656a0b024d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:32.778453 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e94d1e16-e21e-44a2-867e-32656a0b024d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:32.781265 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e94d1e16-e21e-44a2-867e-32656a0b024d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:32.784212 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e94d1e16-e21e-44a2-867e-32656a0b024d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:32.820835 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-77983f98-2927-47a6-af50-5fd13f70092f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:32.846926 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-77983f98-2927-47a6-af50-5fd13f70092f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1522 microversion: 2.1 time: 0.842824 Jan 15 02:40:32.848467 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 59/119] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:32 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1522 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:33.045889 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e94d1e16-e21e-44a2-867e-32656a0b024d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 3277 microversion: 2.20 time: 0.350276 Jan 15 02:40:33.047252 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 61/120] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:40:32 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 3277 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:40:33.893258 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c7777ae6-b89c-4395-ae4c-bac341ea15b1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:33.893258 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c7777ae6-b89c-4395-ae4c-bac341ea15b1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:33.924185 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c7777ae6-b89c-4395-ae4c-bac341ea15b1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:33.925024 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c7777ae6-b89c-4395-ae4c-bac341ea15b1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:33.930761 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c7777ae6-b89c-4395-ae4c-bac341ea15b1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:33.931234 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c7777ae6-b89c-4395-ae4c-bac341ea15b1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:34.088126 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1b6f8af1-cb4c-43d0-ae80-f6c035b4ba20 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:34.089935 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1b6f8af1-cb4c-43d0-ae80-f6c035b4ba20 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:34.121695 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1b6f8af1-cb4c-43d0-ae80-f6c035b4ba20 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:34.122664 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1b6f8af1-cb4c-43d0-ae80-f6c035b4ba20 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:34.132947 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1b6f8af1-cb4c-43d0-ae80-f6c035b4ba20 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:34.134984 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1b6f8af1-cb4c-43d0-ae80-f6c035b4ba20 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:34.391067 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1b6f8af1-cb4c-43d0-ae80-f6c035b4ba20 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 14402 microversion: 2.20 time: 0.332521 Jan 15 02:40:34.393185 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 62/121] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:40:34 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 14402 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 02:40:34.478010 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c7777ae6-b89c-4395-ae4c-bac341ea15b1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:34.488621 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c7777ae6-b89c-4395-ae4c-bac341ea15b1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1522 microversion: 2.1 time: 0.614126 Jan 15 02:40:34.489892 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 60/122] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:33 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1522 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:35.424564 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-55b60281-0e9f-434a-b9d6-93c31af85e68 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:35.425779 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-55b60281-0e9f-434a-b9d6-93c31af85e68 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:35.436100 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-55b60281-0e9f-434a-b9d6-93c31af85e68 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:35.436881 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-55b60281-0e9f-434a-b9d6-93c31af85e68 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:35.437798 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-55b60281-0e9f-434a-b9d6-93c31af85e68 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:35.438309 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-55b60281-0e9f-434a-b9d6-93c31af85e68 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:35.536758 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9aad2ab9-fd4a-49ad-a469-00410e3777d4 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:35.537710 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9aad2ab9-fd4a-49ad-a469-00410e3777d4 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:35.547662 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9aad2ab9-fd4a-49ad-a469-00410e3777d4 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:35.548409 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9aad2ab9-fd4a-49ad-a469-00410e3777d4 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:35.549508 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9aad2ab9-fd4a-49ad-a469-00410e3777d4 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:35.550157 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9aad2ab9-fd4a-49ad-a469-00410e3777d4 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:35.598375 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-55b60281-0e9f-434a-b9d6-93c31af85e68 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 18003 microversion: 2.20 time: 0.191795 Jan 15 02:40:35.600268 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 63/123] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:40:35 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 18003 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 02:40:36.235888 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-9aad2ab9-fd4a-49ad-a469-00410e3777d4 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:36.265872 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9aad2ab9-fd4a-49ad-a469-00410e3777d4 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1522 microversion: 2.1 time: 0.741508 Jan 15 02:40:36.266977 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 61/124] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:35 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1522 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:36.657041 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9ab63a14-5b5b-443b-ab87-3901d3644e02 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:36.668033 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9ab63a14-5b5b-443b-ab87-3901d3644e02 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:36.693377 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9ab63a14-5b5b-443b-ab87-3901d3644e02 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:36.695090 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9ab63a14-5b5b-443b-ab87-3901d3644e02 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:36.696982 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9ab63a14-5b5b-443b-ab87-3901d3644e02 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:36.698300 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9ab63a14-5b5b-443b-ab87-3901d3644e02 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:36.893647 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9ab63a14-5b5b-443b-ab87-3901d3644e02 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 19342 microversion: 2.20 time: 0.281540 Jan 15 02:40:36.895008 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 64/125] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:40:36 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 19342 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:40:37.319203 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-00539ca5-7a52-4058-b849-4d742a9aff7a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:37.320347 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-00539ca5-7a52-4058-b849-4d742a9aff7a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:37.330772 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-00539ca5-7a52-4058-b849-4d742a9aff7a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:37.331525 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-00539ca5-7a52-4058-b849-4d742a9aff7a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:37.333226 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-00539ca5-7a52-4058-b849-4d742a9aff7a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:37.333887 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-00539ca5-7a52-4058-b849-4d742a9aff7a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:37.756095 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-00539ca5-7a52-4058-b849-4d742a9aff7a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:37.774527 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-00539ca5-7a52-4058-b849-4d742a9aff7a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1522 microversion: 2.1 time: 0.474734 Jan 15 02:40:37.775677 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 62/126] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:37 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1522 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:37.937203 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9288384b-e928-4359-8e66-9078ccf8e2dc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:37.939972 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9288384b-e928-4359-8e66-9078ccf8e2dc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:37.963625 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9288384b-e928-4359-8e66-9078ccf8e2dc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:37.966422 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9288384b-e928-4359-8e66-9078ccf8e2dc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:37.968894 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9288384b-e928-4359-8e66-9078ccf8e2dc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:37.970514 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9288384b-e928-4359-8e66-9078ccf8e2dc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:38.253412 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9288384b-e928-4359-8e66-9078ccf8e2dc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 22168 microversion: 2.20 time: 0.346279 Jan 15 02:40:38.254794 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 65/127] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:40:37 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 22168 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:40:38.814505 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4e72df44-1277-4e8e-ad5f-911251d75eff tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:38.815266 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4e72df44-1277-4e8e-ad5f-911251d75eff tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:38.842485 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4e72df44-1277-4e8e-ad5f-911251d75eff tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:38.843967 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4e72df44-1277-4e8e-ad5f-911251d75eff tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:38.847447 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4e72df44-1277-4e8e-ad5f-911251d75eff tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:38.851679 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4e72df44-1277-4e8e-ad5f-911251d75eff tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:39.334242 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-772e655d-bba8-4668-b4df-872589927999 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:39.336162 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-772e655d-bba8-4668-b4df-872589927999 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:39.356428 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-772e655d-bba8-4668-b4df-872589927999 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:39.357299 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-772e655d-bba8-4668-b4df-872589927999 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:39.358507 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-772e655d-bba8-4668-b4df-872589927999 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:39.359366 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-772e655d-bba8-4668-b4df-872589927999 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:39.550816 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-772e655d-bba8-4668-b4df-872589927999 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 23802 microversion: 2.20 time: 0.285550 Jan 15 02:40:39.552382 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 66/128] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:40:39 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 23802 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:40:40.044984 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4e72df44-1277-4e8e-ad5f-911251d75eff tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:40.056608 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4e72df44-1277-4e8e-ad5f-911251d75eff tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1522 microversion: 2.1 time: 1.257880 Jan 15 02:40:40.058102 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 63/129] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:38 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1522 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:40:40.580044 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-050a5d6c-1ed3-4c41-93f3-4827096a7e7f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:40.586777 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-050a5d6c-1ed3-4c41-93f3-4827096a7e7f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:40.619094 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-050a5d6c-1ed3-4c41-93f3-4827096a7e7f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:40.623909 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-050a5d6c-1ed3-4c41-93f3-4827096a7e7f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:40.628245 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-050a5d6c-1ed3-4c41-93f3-4827096a7e7f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:40.632207 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-050a5d6c-1ed3-4c41-93f3-4827096a7e7f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:41.030629 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-050a5d6c-1ed3-4c41-93f3-4827096a7e7f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 25603 microversion: 2.20 time: 0.463936 Jan 15 02:40:41.031686 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 67/130] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:40:40 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 25603 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:40:41.123069 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-cd1028e8-48d7-4abf-911a-fbbd85a4bf8a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:41.124558 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-cd1028e8-48d7-4abf-911a-fbbd85a4bf8a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:41.163230 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cd1028e8-48d7-4abf-911a-fbbd85a4bf8a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:41.164468 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cd1028e8-48d7-4abf-911a-fbbd85a4bf8a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:41.165978 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cd1028e8-48d7-4abf-911a-fbbd85a4bf8a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:41.171636 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cd1028e8-48d7-4abf-911a-fbbd85a4bf8a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:41.928609 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-cd1028e8-48d7-4abf-911a-fbbd85a4bf8a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:41.948210 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-cd1028e8-48d7-4abf-911a-fbbd85a4bf8a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1522 microversion: 2.1 time: 0.862279 Jan 15 02:40:41.950581 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 64/131] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:41 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1522 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:42.102107 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-13d7faef-3622-4359-ab56-228f13621b70 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:42.104466 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-13d7faef-3622-4359-ab56-228f13621b70 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:42.176841 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-13d7faef-3622-4359-ab56-228f13621b70 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:42.182455 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-13d7faef-3622-4359-ab56-228f13621b70 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:42.186904 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-13d7faef-3622-4359-ab56-228f13621b70 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:42.187840 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-13d7faef-3622-4359-ab56-228f13621b70 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:43.006571 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-333b8908-82e9-4052-8f15-30635b828e91 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:43.007808 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-333b8908-82e9-4052-8f15-30635b828e91 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:43.045330 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-333b8908-82e9-4052-8f15-30635b828e91 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:43.046089 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-333b8908-82e9-4052-8f15-30635b828e91 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:43.048022 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-333b8908-82e9-4052-8f15-30635b828e91 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:43.048022 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-333b8908-82e9-4052-8f15-30635b828e91 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:43.840962 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-333b8908-82e9-4052-8f15-30635b828e91 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:43.869437 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-333b8908-82e9-4052-8f15-30635b828e91 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1522 microversion: 2.1 time: 0.894760 Jan 15 02:40:43.870089 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 65/132] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:42 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1522 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:44.246052 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-13d7faef-3622-4359-ab56-228f13621b70 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 27578 microversion: 2.20 time: 2.198740 Jan 15 02:40:44.246052 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 68/133] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:40:42 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 27578 bytes in 2203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:40:44.895609 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-bd698717-edb0-4f07-a4ae-faa46e7a0d05 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:44.899584 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-bd698717-edb0-4f07-a4ae-faa46e7a0d05 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:44.940163 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bd698717-edb0-4f07-a4ae-faa46e7a0d05 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:44.942315 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bd698717-edb0-4f07-a4ae-faa46e7a0d05 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:44.948283 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bd698717-edb0-4f07-a4ae-faa46e7a0d05 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:44.953711 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bd698717-edb0-4f07-a4ae-faa46e7a0d05 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:45.263523 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3ce2370c-ede5-4198-8664-2a844be14bf5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:45.269936 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3ce2370c-ede5-4198-8664-2a844be14bf5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:45.291291 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3ce2370c-ede5-4198-8664-2a844be14bf5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:45.294102 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3ce2370c-ede5-4198-8664-2a844be14bf5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:45.306669 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3ce2370c-ede5-4198-8664-2a844be14bf5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:45.308006 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3ce2370c-ede5-4198-8664-2a844be14bf5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:46.654485 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-bd698717-edb0-4f07-a4ae-faa46e7a0d05 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:46.705316 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-bd698717-edb0-4f07-a4ae-faa46e7a0d05 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1522 microversion: 2.1 time: 1.812580 Jan 15 02:40:46.706811 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 66/134] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:44 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1522 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:47.767993 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-039bd414-d547-4393-af5e-fc84cecf7930 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:47.777054 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-039bd414-d547-4393-af5e-fc84cecf7930 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:47.828306 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-039bd414-d547-4393-af5e-fc84cecf7930 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:47.829368 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-039bd414-d547-4393-af5e-fc84cecf7930 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:47.830974 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-039bd414-d547-4393-af5e-fc84cecf7930 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:47.831905 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-039bd414-d547-4393-af5e-fc84cecf7930 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:48.337381 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3ce2370c-ede5-4198-8664-2a844be14bf5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 28248 microversion: 2.20 time: 3.084419 Jan 15 02:40:48.344579 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 69/135] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:40:45 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 28248 bytes in 3088 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 02:40:48.974723 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-039bd414-d547-4393-af5e-fc84cecf7930 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:49.004895 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-039bd414-d547-4393-af5e-fc84cecf7930 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1522 microversion: 2.1 time: 1.283895 Jan 15 02:40:49.006161 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 67/136] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:47 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1522 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:40:49.369436 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-db1dddce-27a3-47a9-88a5-8a3c7a3dacbe tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:49.374379 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-db1dddce-27a3-47a9-88a5-8a3c7a3dacbe tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:49.417840 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-db1dddce-27a3-47a9-88a5-8a3c7a3dacbe tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:49.419758 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-db1dddce-27a3-47a9-88a5-8a3c7a3dacbe tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:49.421876 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-db1dddce-27a3-47a9-88a5-8a3c7a3dacbe tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:49.424599 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-db1dddce-27a3-47a9-88a5-8a3c7a3dacbe tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:49.905674 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-db1dddce-27a3-47a9-88a5-8a3c7a3dacbe tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 28248 microversion: 2.20 time: 0.555617 Jan 15 02:40:49.912262 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 70/137] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:40:49 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 28248 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:40:50.056031 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e7bb0e80-eace-4412-baa9-b3f29d832998 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:50.056872 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e7bb0e80-eace-4412-baa9-b3f29d832998 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:50.095886 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e7bb0e80-eace-4412-baa9-b3f29d832998 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:50.096519 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e7bb0e80-eace-4412-baa9-b3f29d832998 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:50.098525 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e7bb0e80-eace-4412-baa9-b3f29d832998 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:50.104872 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e7bb0e80-eace-4412-baa9-b3f29d832998 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:50.960724 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1ed71a89-7506-4418-b6a4-6666fdd299f6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:50.967086 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1ed71a89-7506-4418-b6a4-6666fdd299f6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:51.019285 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1ed71a89-7506-4418-b6a4-6666fdd299f6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:51.019847 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1ed71a89-7506-4418-b6a4-6666fdd299f6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:51.025526 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1ed71a89-7506-4418-b6a4-6666fdd299f6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:51.026574 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1ed71a89-7506-4418-b6a4-6666fdd299f6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:51.587884 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1ed71a89-7506-4418-b6a4-6666fdd299f6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 28539 microversion: 2.20 time: 0.667082 Jan 15 02:40:51.592804 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 71/138] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:40:50 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 28539 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:40:52.123871 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e7bb0e80-eace-4412-baa9-b3f29d832998 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:52.192072 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e7bb0e80-eace-4412-baa9-b3f29d832998 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1522 microversion: 2.1 time: 2.152229 Jan 15 02:40:52.221462 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 68/139] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:50 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1522 bytes in 2173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:52.650389 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-8d8194a0-55a0-4b43-98f7-85c196958ff1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:52.666740 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8d8194a0-55a0-4b43-98f7-85c196958ff1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:52.702238 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8d8194a0-55a0-4b43-98f7-85c196958ff1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:52.703103 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8d8194a0-55a0-4b43-98f7-85c196958ff1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:52.705026 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8d8194a0-55a0-4b43-98f7-85c196958ff1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:52.705935 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8d8194a0-55a0-4b43-98f7-85c196958ff1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:52.930163 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-8d8194a0-55a0-4b43-98f7-85c196958ff1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 28707 microversion: 2.20 time: 0.325842 Jan 15 02:40:52.931283 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 72/140] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:40:52 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 28707 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:40:53.257428 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e44d2b81-b8d0-400d-940e-aebdee8ea7b7 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:53.258610 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e44d2b81-b8d0-400d-940e-aebdee8ea7b7 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:53.298626 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e44d2b81-b8d0-400d-940e-aebdee8ea7b7 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:53.300330 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e44d2b81-b8d0-400d-940e-aebdee8ea7b7 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:53.302898 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e44d2b81-b8d0-400d-940e-aebdee8ea7b7 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:53.309931 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e44d2b81-b8d0-400d-940e-aebdee8ea7b7 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:53.963002 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-63e8e7a7-a23f-46a0-9b6e-e6db9ae30bab tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:53.969143 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-63e8e7a7-a23f-46a0-9b6e-e6db9ae30bab tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:54.002921 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-63e8e7a7-a23f-46a0-9b6e-e6db9ae30bab tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:54.004064 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-63e8e7a7-a23f-46a0-9b6e-e6db9ae30bab tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:54.011698 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-63e8e7a7-a23f-46a0-9b6e-e6db9ae30bab tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:54.013410 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-63e8e7a7-a23f-46a0-9b6e-e6db9ae30bab tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:54.382458 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e44d2b81-b8d0-400d-940e-aebdee8ea7b7 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:54.421531 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e44d2b81-b8d0-400d-940e-aebdee8ea7b7 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1502 microversion: 2.1 time: 1.195204 Jan 15 02:40:54.423013 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 69/141] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:53 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1502 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:54.449278 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a308f867-27f6-4283-8258-c1732eb723b0 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:54.450429 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a308f867-27f6-4283-8258-c1732eb723b0 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:54.457764 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-63e8e7a7-a23f-46a0-9b6e-e6db9ae30bab tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 28707 microversion: 2.20 time: 0.515131 Jan 15 02:40:54.459690 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 73/142] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:40:53 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 28707 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:40:54.467042 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a308f867-27f6-4283-8258-c1732eb723b0 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:54.467823 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a308f867-27f6-4283-8258-c1732eb723b0 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:54.470578 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a308f867-27f6-4283-8258-c1732eb723b0 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:54.471258 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a308f867-27f6-4283-8258-c1732eb723b0 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:55.026594 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a308f867-27f6-4283-8258-c1732eb723b0 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:55.067346 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a308f867-27f6-4283-8258-c1732eb723b0 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1516 microversion: 2.1 time: 0.629255 Jan 15 02:40:55.074878 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 70/143] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:54 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1516 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:55.488937 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e85f7c04-39f4-4071-8353-fd93d9b8eefe tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:55.490644 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e85f7c04-39f4-4071-8353-fd93d9b8eefe tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:55.514041 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e85f7c04-39f4-4071-8353-fd93d9b8eefe tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:55.525601 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e85f7c04-39f4-4071-8353-fd93d9b8eefe tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:55.527606 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e85f7c04-39f4-4071-8353-fd93d9b8eefe tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:55.528356 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e85f7c04-39f4-4071-8353-fd93d9b8eefe tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:55.744719 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e85f7c04-39f4-4071-8353-fd93d9b8eefe tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 28707 microversion: 2.20 time: 0.274077 Jan 15 02:40:55.746978 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 74/144] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:40:55 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 28707 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:40:56.746573 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-14565d71-2675-44ff-9116-c6641369dad7 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1662384133", "imageRef": "1807a1cb-835d-4a56-8751-82ffa40b12c9", "flavorRef": "452", "networks": [{"uuid": "02affeb9-1ed6-4661-a47f-99c47b7eaf89"}]}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:56.972393 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-14565d71-2675-44ff-9116-c6641369dad7 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] validate_networks() for [('02affeb9-1ed6-4661-a47f-99c47b7eaf89', None, None, None)] {{(pid=94111) validate_networks /opt/stack/nova/nova/network/neutron.py:2340}} Jan 15 02:40:57.065342 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c6e87073-002e-4578-90ae-ae316eb161aa tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'create', calling method: .version_select at 0x7f87904c6f28>, body: {"keypair": {"name": "tempest-keypair-826258009"}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:57.141590 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-c6e87073-002e-4578-90ae-ae316eb161aa tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Getting quotas for project 9ae05708286f4222bc7584d7b1dea622. Resources: {'key_pairs'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:40:57.148211 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-c6e87073-002e-4578-90ae-ae316eb161aa tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Getting quotas for user 89505fd3686440cc939ec8fbe725ee90 and project 9ae05708286f4222bc7584d7b1dea622. Resources: {'key_pairs'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:40:57.467376 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-c6e87073-002e-4578-90ae-ae316eb161aa tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Getting quotas for project 9ae05708286f4222bc7584d7b1dea622. Resources: {'key_pairs'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:40:57.473181 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-c6e87073-002e-4578-90ae-ae316eb161aa tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Getting quotas for user 89505fd3686440cc939ec8fbe725ee90 and project 9ae05708286f4222bc7584d7b1dea622. Resources: {'key_pairs'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:40:57.495443 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c6e87073-002e-4578-90ae-ae316eb161aa tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.832782 Jan 15 02:40:57.496854 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 71/145] 10.222.0.37 () {60 vars in 1148 bytes} [Fri Jan 15 02:40:56 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:57.510070 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9e611103-3824-4ef2-82fa-f42a9b959a06 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:57.512432 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9e611103-3824-4ef2-82fa-f42a9b959a06 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:57.523911 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9e611103-3824-4ef2-82fa-f42a9b959a06 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:57.524727 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9e611103-3824-4ef2-82fa-f42a9b959a06 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:57.526674 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9e611103-3824-4ef2-82fa-f42a9b959a06 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:57.528065 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9e611103-3824-4ef2-82fa-f42a9b959a06 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:57.749762 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9e611103-3824-4ef2-82fa-f42a9b959a06 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 29906 microversion: 2.20 time: 0.249010 Jan 15 02:40:57.752896 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 72/146] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:40:57 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 29906 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:40:58.571247 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-0606369a-97ef-4758-b73d-2611575e066c tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:58.573438 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-0606369a-97ef-4758-b73d-2611575e066c tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:58.583723 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0606369a-97ef-4758-b73d-2611575e066c tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:58.584610 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0606369a-97ef-4758-b73d-2611575e066c tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:58.585739 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0606369a-97ef-4758-b73d-2611575e066c tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:58.586433 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0606369a-97ef-4758-b73d-2611575e066c tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:58.667928 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.objects.instance [None req-0606369a-97ef-4758-b73d-2611575e066c tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lazy-loading 'flavor' on Instance uuid e90ce195-f423-416c-859f-a6423d99efe6 {{(pid=94112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Jan 15 02:40:58.917144 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-0606369a-97ef-4758-b73d-2611575e066c tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "POST /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6/action" status: 200 len: 32 microversion: 2.1 time: 0.350957 Jan 15 02:40:58.923139 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 73/147] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:40:58 2021] POST /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6/action => generated 32 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:40:58.941413 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5bcfd91f-b26b-4477-9235-3c8cc47f43b4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:40:58.942738 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5bcfd91f-b26b-4477-9235-3c8cc47f43b4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:58.952911 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5bcfd91f-b26b-4477-9235-3c8cc47f43b4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:58.953646 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5bcfd91f-b26b-4477-9235-3c8cc47f43b4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:58.954850 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5bcfd91f-b26b-4477-9235-3c8cc47f43b4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:58.955583 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5bcfd91f-b26b-4477-9235-3c8cc47f43b4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:59.065978 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-14565d71-2675-44ff-9116-c6641369dad7 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Flavor limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 02:40:59.066795 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-14565d71-2675-44ff-9116-c6641369dad7 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Image limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Jan 15 02:40:59.067526 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-14565d71-2675-44ff-9116-c6641369dad7 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Flavor pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 02:40:59.068333 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-14565d71-2675-44ff-9116-c6641369dad7 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Image pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Jan 15 02:40:59.068987 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-14565d71-2675-44ff-9116-c6641369dad7 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Jan 15 02:40:59.080987 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-14565d71-2675-44ff-9116-c6641369dad7 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:59.081777 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-14565d71-2675-44ff-9116-c6641369dad7 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:59.083176 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-14565d71-2675-44ff-9116-c6641369dad7 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:59.083492 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-14565d71-2675-44ff-9116-c6641369dad7 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:59.111094 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-14565d71-2675-44ff-9116-c6641369dad7 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Getting quotas for project 0afa87010f244e1b998f04858f116ee6. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:40:59.116542 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-14565d71-2675-44ff-9116-c6641369dad7 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Getting quotas for user 394c8449171243ed9871a947b62c02d3 and project 0afa87010f244e1b998f04858f116ee6. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:40:59.132342 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-14565d71-2675-44ff-9116-c6641369dad7 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Going to run 1 instances... {{(pid=94111) _provision_instances /opt/stack/nova/nova/compute/api.py:1263}} Jan 15 02:40:59.136417 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-14565d71-2675-44ff-9116-c6641369dad7 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 10ed9ee0-28da-4fab-a4fc-3c52751013f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1807a1cb-835d-4a56-8751-82ffa40b12c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1661}} Jan 15 02:40:59.202881 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-14565d71-2675-44ff-9116-c6641369dad7 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.478330 Jan 15 02:40:59.203604 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 75/148] 10.222.0.37 () {60 vars in 1137 bytes} [Fri Jan 15 02:40:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 2480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 02:40:59.232648 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1672bc0f-c097-4ab7-bd6d-9d604e3f8b60 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:59.232962 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1672bc0f-c097-4ab7-bd6d-9d604e3f8b60 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:40:59.246967 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1672bc0f-c097-4ab7-bd6d-9d604e3f8b60 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:59.247691 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1672bc0f-c097-4ab7-bd6d-9d604e3f8b60 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:59.248726 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1672bc0f-c097-4ab7-bd6d-9d604e3f8b60 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:40:59.249403 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1672bc0f-c097-4ab7-bd6d-9d604e3f8b60 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:40:59.732414 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1672bc0f-c097-4ab7-bd6d-9d604e3f8b60 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:40:59.768065 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1672bc0f-c097-4ab7-bd6d-9d604e3f8b60 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1522 microversion: 2.1 time: 0.555759 Jan 15 02:40:59.769602 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 76/149] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:59 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1522 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:40:59.800970 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-093abbb5-950d-4a6d-b0a3-a4ec40f33bdf tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:40:59.809226 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-093abbb5-950d-4a6d-b0a3-a4ec40f33bdf tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 10ed9ee0-28da-4fab-a4fc-3c52751013f2] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:00.078860 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-093abbb5-950d-4a6d-b0a3-a4ec40f33bdf tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:00.095804 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-093abbb5-950d-4a6d-b0a3-a4ec40f33bdf tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2" status: 200 len: 1214 microversion: 2.1 time: 0.324201 Jan 15 02:41:00.096439 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 77/150] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:40:59 2021] GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2 => generated 1214 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:00.798126 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-440ee75c-cbf1-4113-861a-00476a39711c tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:00.799153 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-440ee75c-cbf1-4113-861a-00476a39711c tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:00.810990 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-440ee75c-cbf1-4113-861a-00476a39711c tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:00.811509 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-440ee75c-cbf1-4113-861a-00476a39711c tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:00.812363 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-440ee75c-cbf1-4113-861a-00476a39711c tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:00.813222 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-440ee75c-cbf1-4113-861a-00476a39711c tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:01.197603 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-440ee75c-cbf1-4113-861a-00476a39711c tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:01.219397 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-440ee75c-cbf1-4113-861a-00476a39711c tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1522 microversion: 2.1 time: 0.430696 Jan 15 02:41:01.220931 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 78/151] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:00 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:41:01.265789 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d13be564-f413-44e3-9f62-2198be38f5ed tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:01.284854 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d13be564-f413-44e3-9f62-2198be38f5ed tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 10ed9ee0-28da-4fab-a4fc-3c52751013f2] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:01.307997 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d13be564-f413-44e3-9f62-2198be38f5ed tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:01.308722 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d13be564-f413-44e3-9f62-2198be38f5ed tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:01.310341 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d13be564-f413-44e3-9f62-2198be38f5ed tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:01.311212 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d13be564-f413-44e3-9f62-2198be38f5ed tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:01.486047 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d13be564-f413-44e3-9f62-2198be38f5ed tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:01.497928 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d13be564-f413-44e3-9f62-2198be38f5ed tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2" status: 200 len: 1218 microversion: 2.1 time: 0.274489 Jan 15 02:41:01.498580 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 79/152] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:01 2021] GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2 => generated 1218 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:01.736291 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5bcfd91f-b26b-4477-9235-3c8cc47f43b4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 34593 microversion: 2.20 time: 2.810867 Jan 15 02:41:01.738454 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 74/153] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:40:58 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 34593 bytes in 2815 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:41:02.251317 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-fd24def7-a6f3-46ab-a54a-5c133f1006c1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:02.252697 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-fd24def7-a6f3-46ab-a54a-5c133f1006c1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:02.264226 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fd24def7-a6f3-46ab-a54a-5c133f1006c1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:02.265320 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fd24def7-a6f3-46ab-a54a-5c133f1006c1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:02.266525 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fd24def7-a6f3-46ab-a54a-5c133f1006c1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:02.267206 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fd24def7-a6f3-46ab-a54a-5c133f1006c1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:02.529093 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-884e6a44-9b3b-401d-bdce-7c7e3cd4a619 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:02.531528 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-884e6a44-9b3b-401d-bdce-7c7e3cd4a619 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 10ed9ee0-28da-4fab-a4fc-3c52751013f2] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:02.542320 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-884e6a44-9b3b-401d-bdce-7c7e3cd4a619 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:02.543280 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-884e6a44-9b3b-401d-bdce-7c7e3cd4a619 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:02.544381 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-884e6a44-9b3b-401d-bdce-7c7e3cd4a619 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:02.545083 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-884e6a44-9b3b-401d-bdce-7c7e3cd4a619 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:02.850133 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-fd24def7-a6f3-46ab-a54a-5c133f1006c1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:02.878556 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-fd24def7-a6f3-46ab-a54a-5c133f1006c1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1522 microversion: 2.1 time: 0.636655 Jan 15 02:41:02.879974 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 80/154] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:02 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1522 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:02.933970 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7a1aa476-b016-45f4-9d18-b7efe5906f16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:02.940443 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-7a1aa476-b016-45f4-9d18-b7efe5906f16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:02.978283 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7a1aa476-b016-45f4-9d18-b7efe5906f16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:02.979266 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7a1aa476-b016-45f4-9d18-b7efe5906f16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:02.981364 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7a1aa476-b016-45f4-9d18-b7efe5906f16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:02.982243 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7a1aa476-b016-45f4-9d18-b7efe5906f16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:03.006517 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-884e6a44-9b3b-401d-bdce-7c7e3cd4a619 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:03.042301 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-884e6a44-9b3b-401d-bdce-7c7e3cd4a619 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2" status: 200 len: 1266 microversion: 2.1 time: 0.525916 Jan 15 02:41:03.049548 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 75/155] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:02 2021] GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2 => generated 1266 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:03.426487 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-7a1aa476-b016-45f4-9d18-b7efe5906f16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 36348 microversion: 2.20 time: 0.544007 Jan 15 02:41:03.431624 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 81/156] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:41:02 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 36348 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:41:03.933952 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-bd5cca99-ecb1-43a3-acca-88bf2a7c8730 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:03.935218 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-bd5cca99-ecb1-43a3-acca-88bf2a7c8730 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:03.964350 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bd5cca99-ecb1-43a3-acca-88bf2a7c8730 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:03.965088 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bd5cca99-ecb1-43a3-acca-88bf2a7c8730 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:03.966743 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bd5cca99-ecb1-43a3-acca-88bf2a7c8730 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:03.967698 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bd5cca99-ecb1-43a3-acca-88bf2a7c8730 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:04.168588 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5ab84667-5ede-4ee3-a0c5-61d06c198da4 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:04.169988 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5ab84667-5ede-4ee3-a0c5-61d06c198da4 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 10ed9ee0-28da-4fab-a4fc-3c52751013f2] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:04.235738 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5ab84667-5ede-4ee3-a0c5-61d06c198da4 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:04.247634 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5ab84667-5ede-4ee3-a0c5-61d06c198da4 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:04.249478 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5ab84667-5ede-4ee3-a0c5-61d06c198da4 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:04.250391 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5ab84667-5ede-4ee3-a0c5-61d06c198da4 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:04.852975 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-5ab84667-5ede-4ee3-a0c5-61d06c198da4 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:04.897330 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5ab84667-5ede-4ee3-a0c5-61d06c198da4 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2" status: 200 len: 1272 microversion: 2.1 time: 0.817464 Jan 15 02:41:04.903476 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 82/157] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:04 2021] GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2 => generated 1272 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:04.967812 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-8bb9732b-cd30-40b8-afc8-d09c7f84cea4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:04.974085 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8bb9732b-cd30-40b8-afc8-d09c7f84cea4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:05.027138 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8bb9732b-cd30-40b8-afc8-d09c7f84cea4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:05.028709 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8bb9732b-cd30-40b8-afc8-d09c7f84cea4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:05.030888 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8bb9732b-cd30-40b8-afc8-d09c7f84cea4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:05.032305 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8bb9732b-cd30-40b8-afc8-d09c7f84cea4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:05.489559 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-8bb9732b-cd30-40b8-afc8-d09c7f84cea4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 38264 microversion: 2.20 time: 0.580891 Jan 15 02:41:05.493197 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 83/158] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:41:04 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 38264 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:41:05.554370 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-8eac6ce5-3960-47cf-b04b-dc3a9180d648 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1911451853", "imageRef": "1807a1cb-835d-4a56-8751-82ffa40b12c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f773a4fc-cf3f-4ca8-a066-31288f50d5f7"}], "security_groups": [{"name": "tempest-securitygroup--1972356378"}], "key_name": "tempest-keypair-826258009", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:05.957556 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-8eac6ce5-3960-47cf-b04b-dc3a9180d648 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] validate_networks() for [('f773a4fc-cf3f-4ca8-a066-31288f50d5f7', None, None, None)] {{(pid=94111) validate_networks /opt/stack/nova/nova/network/neutron.py:2340}} Jan 15 02:41:07.104904 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-bd5cca99-ecb1-43a3-acca-88bf2a7c8730 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:07.133103 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-bd5cca99-ecb1-43a3-acca-88bf2a7c8730 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1522 microversion: 2.1 time: 3.237970 Jan 15 02:41:07.139973 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 76/159] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:03 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1522 bytes in 3246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:07.159425 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-86df20f4-b7a9-43cf-a026-405a89c066a8 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:07.160109 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-86df20f4-b7a9-43cf-a026-405a89c066a8 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 10ed9ee0-28da-4fab-a4fc-3c52751013f2] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:07.193548 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-86df20f4-b7a9-43cf-a026-405a89c066a8 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:07.194378 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-86df20f4-b7a9-43cf-a026-405a89c066a8 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:07.195465 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-86df20f4-b7a9-43cf-a026-405a89c066a8 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:07.196131 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-86df20f4-b7a9-43cf-a026-405a89c066a8 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:07.350280 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-8eac6ce5-3960-47cf-b04b-dc3a9180d648 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Flavor limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 02:41:07.352521 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-8eac6ce5-3960-47cf-b04b-dc3a9180d648 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Image limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Jan 15 02:41:07.355087 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-8eac6ce5-3960-47cf-b04b-dc3a9180d648 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Flavor pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 02:41:07.356985 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-8eac6ce5-3960-47cf-b04b-dc3a9180d648 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Image pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Jan 15 02:41:07.358387 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-8eac6ce5-3960-47cf-b04b-dc3a9180d648 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Jan 15 02:41:07.391677 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8eac6ce5-3960-47cf-b04b-dc3a9180d648 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:07.403808 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8eac6ce5-3960-47cf-b04b-dc3a9180d648 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:07.408756 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8eac6ce5-3960-47cf-b04b-dc3a9180d648 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:07.410055 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8eac6ce5-3960-47cf-b04b-dc3a9180d648 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:07.458004 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-8eac6ce5-3960-47cf-b04b-dc3a9180d648 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Getting quotas for project 9ae05708286f4222bc7584d7b1dea622. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:41:07.468920 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-8eac6ce5-3960-47cf-b04b-dc3a9180d648 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Getting quotas for user 89505fd3686440cc939ec8fbe725ee90 and project 9ae05708286f4222bc7584d7b1dea622. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:41:07.504581 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8eac6ce5-3960-47cf-b04b-dc3a9180d648 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Going to run 1 instances... {{(pid=94111) _provision_instances /opt/stack/nova/nova/compute/api.py:1263}} Jan 15 02:41:07.511251 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8eac6ce5-3960-47cf-b04b-dc3a9180d648 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1807a1cb-835d-4a56-8751-82ffa40b12c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1661}} Jan 15 02:41:07.516732 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-86df20f4-b7a9-43cf-a026-405a89c066a8 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:07.542882 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-86df20f4-b7a9-43cf-a026-405a89c066a8 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2" status: 200 len: 1272 microversion: 2.1 time: 0.400239 Jan 15 02:41:07.546748 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 77/160] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:07 2021] GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2 => generated 1272 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:07.586728 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-abf2a3ed-194a-46a3-9202-4a57c672248f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:07.590119 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-abf2a3ed-194a-46a3-9202-4a57c672248f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:07.608070 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-abf2a3ed-194a-46a3-9202-4a57c672248f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:07.613694 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-abf2a3ed-194a-46a3-9202-4a57c672248f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:07.615476 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-abf2a3ed-194a-46a3-9202-4a57c672248f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:07.620711 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-abf2a3ed-194a-46a3-9202-4a57c672248f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:07.726327 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-8eac6ce5-3960-47cf-b04b-dc3a9180d648 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.230038 Jan 15 02:41:07.738392 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 84/161] 10.222.0.37 () {60 vars in 1137 bytes} [Fri Jan 15 02:41:05 2021] POST /compute/v2.1/servers => generated 402 bytes in 2245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 02:41:07.802002 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-085777d4-2565-46b3-b496-20c2e6892a14 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:07.803741 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-085777d4-2565-46b3-b496-20c2e6892a14 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:07.952361 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-abf2a3ed-194a-46a3-9202-4a57c672248f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 38264 microversion: 2.20 time: 0.397344 Jan 15 02:41:07.956752 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 78/162] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:41:07 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 38264 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:41:08.067541 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-085777d4-2565-46b3-b496-20c2e6892a14 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:08.089630 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-085777d4-2565-46b3-b496-20c2e6892a14 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1237 microversion: 2.1 time: 0.348412 Jan 15 02:41:08.103044 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 85/163] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:07 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1237 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:08.172176 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9914d589-b80d-47da-bb89-46b7b7b87c33 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:08.172906 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9914d589-b80d-47da-bb89-46b7b7b87c33 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:08.189458 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9914d589-b80d-47da-bb89-46b7b7b87c33 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:08.189995 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9914d589-b80d-47da-bb89-46b7b7b87c33 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:08.191253 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9914d589-b80d-47da-bb89-46b7b7b87c33 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:08.191759 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9914d589-b80d-47da-bb89-46b7b7b87c33 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:08.241991 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a4ff8118-b2e2-4dfe-8c4e-6bdd526fa869 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-405115086", "imageRef": "1807a1cb-835d-4a56-8751-82ffa40b12c9", "flavorRef": "452"}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:08.370712 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-a4ff8118-b2e2-4dfe-8c4e-6bdd526fa869 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] validate_networks() for None {{(pid=94111) validate_networks /opt/stack/nova/nova/network/neutron.py:2340}} Jan 15 02:41:08.718469 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-a4ff8118-b2e2-4dfe-8c4e-6bdd526fa869 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Flavor limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 02:41:08.719221 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-a4ff8118-b2e2-4dfe-8c4e-6bdd526fa869 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Image limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Jan 15 02:41:08.720176 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-a4ff8118-b2e2-4dfe-8c4e-6bdd526fa869 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Flavor pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 02:41:08.720646 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-a4ff8118-b2e2-4dfe-8c4e-6bdd526fa869 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Image pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Jan 15 02:41:08.721144 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-a4ff8118-b2e2-4dfe-8c4e-6bdd526fa869 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Jan 15 02:41:08.732092 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a4ff8118-b2e2-4dfe-8c4e-6bdd526fa869 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:08.732609 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a4ff8118-b2e2-4dfe-8c4e-6bdd526fa869 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:08.733606 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a4ff8118-b2e2-4dfe-8c4e-6bdd526fa869 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:08.734103 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a4ff8118-b2e2-4dfe-8c4e-6bdd526fa869 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:08.755304 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-a4ff8118-b2e2-4dfe-8c4e-6bdd526fa869 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Getting quotas for project 81b2895583774e1fb625c9bf7dac65b3. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:41:08.761632 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-a4ff8118-b2e2-4dfe-8c4e-6bdd526fa869 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Getting quotas for user 6b609b787be042b5bd55b9019a351a86 and project 81b2895583774e1fb625c9bf7dac65b3. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:41:08.774760 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a4ff8118-b2e2-4dfe-8c4e-6bdd526fa869 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Going to run 1 instances... {{(pid=94111) _provision_instances /opt/stack/nova/nova/compute/api.py:1263}} Jan 15 02:41:08.778488 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a4ff8118-b2e2-4dfe-8c4e-6bdd526fa869 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] [instance: 9afd72bb-19e4-4afc-a01b-8c289d6a572b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1807a1cb-835d-4a56-8751-82ffa40b12c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1661}} Jan 15 02:41:08.836293 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a4ff8118-b2e2-4dfe-8c4e-6bdd526fa869 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603937 Jan 15 02:41:08.843710 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 86/164] 10.222.0.37 () {60 vars in 1137 bytes} [Fri Jan 15 02:41:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 15 02:41:08.854503 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-00cdb089-a678-4c8a-a639-37c75659aa03 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:08.855577 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-00cdb089-a678-4c8a-a639-37c75659aa03 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 10ed9ee0-28da-4fab-a4fc-3c52751013f2] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:08.865532 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-00cdb089-a678-4c8a-a639-37c75659aa03 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:08.865959 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-00cdb089-a678-4c8a-a639-37c75659aa03 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:08.867018 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-00cdb089-a678-4c8a-a639-37c75659aa03 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:08.867520 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-00cdb089-a678-4c8a-a639-37c75659aa03 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:09.184643 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-00cdb089-a678-4c8a-a639-37c75659aa03 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:09.195217 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-00cdb089-a678-4c8a-a639-37c75659aa03 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2" status: 200 len: 1314 microversion: 2.1 time: 0.354894 Jan 15 02:41:09.211527 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 87/165] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:08 2021] GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:09.235211 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3122a6ab-635e-4409-84a0-a8cdc7810506 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:09.237843 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3122a6ab-635e-4409-84a0-a8cdc7810506 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] [instance: 9afd72bb-19e4-4afc-a01b-8c289d6a572b] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:09.382160 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3122a6ab-635e-4409-84a0-a8cdc7810506 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b609b787be042b5bd55b9019a351a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b2895583774e1fb625c9bf7dac65b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:09.403669 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3122a6ab-635e-4409-84a0-a8cdc7810506 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] 10.222.0.37 "GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b" status: 200 len: 1214 microversion: 2.1 time: 0.190617 Jan 15 02:41:09.404662 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 88/166] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:09 2021] GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b => generated 1214 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:09.408568 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-9914d589-b80d-47da-bb89-46b7b7b87c33 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:09.417147 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-89831d44-93b2-4b56-8cdf-a0004d591beb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:09.418938 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-89831d44-93b2-4b56-8cdf-a0004d591beb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:09.428162 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-89831d44-93b2-4b56-8cdf-a0004d591beb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:09.428968 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-89831d44-93b2-4b56-8cdf-a0004d591beb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:09.430122 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-89831d44-93b2-4b56-8cdf-a0004d591beb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:09.430819 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-89831d44-93b2-4b56-8cdf-a0004d591beb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:09.443847 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9914d589-b80d-47da-bb89-46b7b7b87c33 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1522 microversion: 2.1 time: 1.292887 Jan 15 02:41:09.462458 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 79/167] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:08 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1522 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:41:09.542639 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1269c4e1-769b-43c1-9b9f-232032e27e8a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:09.543734 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1269c4e1-769b-43c1-9b9f-232032e27e8a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:09.575952 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1269c4e1-769b-43c1-9b9f-232032e27e8a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:09.576720 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1269c4e1-769b-43c1-9b9f-232032e27e8a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:09.578620 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1269c4e1-769b-43c1-9b9f-232032e27e8a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:09.579291 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1269c4e1-769b-43c1-9b9f-232032e27e8a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:09.649145 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-89831d44-93b2-4b56-8cdf-a0004d591beb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 200 len: 38407 microversion: 2.20 time: 0.242683 Jan 15 02:41:09.650799 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 89/168] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:41:09 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 38407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:41:09.673543 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-fb17cd3f-8a01-45b3-a5e7-5d2b225ed983 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:09.680023 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-fb17cd3f-8a01-45b3-a5e7-5d2b225ed983 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:09.701017 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fb17cd3f-8a01-45b3-a5e7-5d2b225ed983 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:09.701686 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fb17cd3f-8a01-45b3-a5e7-5d2b225ed983 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:09.702730 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fb17cd3f-8a01-45b3-a5e7-5d2b225ed983 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:09.704212 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fb17cd3f-8a01-45b3-a5e7-5d2b225ed983 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:09.878849 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-fb17cd3f-8a01-45b3-a5e7-5d2b225ed983 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/ips" status: 200 len: 153 microversion: 2.20 time: 0.218914 Jan 15 02:41:09.897405 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 90/169] 10.222.0.37 () {60 vars in 1279 bytes} [Fri Jan 15 02:41:09 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/ips => generated 153 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:41:10.239097 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-bf445d27-650d-41cb-994a-eb245622ec6c tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:10.239793 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-bf445d27-650d-41cb-994a-eb245622ec6c tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 10ed9ee0-28da-4fab-a4fc-3c52751013f2] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:10.267248 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1269c4e1-769b-43c1-9b9f-232032e27e8a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:10.270531 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bf445d27-650d-41cb-994a-eb245622ec6c tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:10.271058 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bf445d27-650d-41cb-994a-eb245622ec6c tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:10.272201 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bf445d27-650d-41cb-994a-eb245622ec6c tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:10.272796 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bf445d27-650d-41cb-994a-eb245622ec6c tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:10.292672 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1269c4e1-769b-43c1-9b9f-232032e27e8a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1297 microversion: 2.1 time: 0.826169 Jan 15 02:41:10.297914 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 80/170] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:09 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1297 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:10.438708 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e743d7fe-a2d6-411f-8e33-6e2f54c730e4 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:10.439743 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e743d7fe-a2d6-411f-8e33-6e2f54c730e4 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] [instance: 9afd72bb-19e4-4afc-a01b-8c289d6a572b] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:10.465905 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e743d7fe-a2d6-411f-8e33-6e2f54c730e4 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:10.466666 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e743d7fe-a2d6-411f-8e33-6e2f54c730e4 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:10.467711 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e743d7fe-a2d6-411f-8e33-6e2f54c730e4 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:10.472524 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e743d7fe-a2d6-411f-8e33-6e2f54c730e4 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:10.897411 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e743d7fe-a2d6-411f-8e33-6e2f54c730e4 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b609b787be042b5bd55b9019a351a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b2895583774e1fb625c9bf7dac65b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:10.942874 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e743d7fe-a2d6-411f-8e33-6e2f54c730e4 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] 10.222.0.37 "GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b" status: 200 len: 1266 microversion: 2.1 time: 0.521888 Jan 15 02:41:10.943816 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 81/171] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:10 2021] GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b => generated 1266 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:41:10.979852 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-16ff2135-6eb8-459f-9e09-d9df78cea212 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:10.990592 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-16ff2135-6eb8-459f-9e09-d9df78cea212 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:11.011979 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-16ff2135-6eb8-459f-9e09-d9df78cea212 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:11.012473 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-16ff2135-6eb8-459f-9e09-d9df78cea212 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:11.017338 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-16ff2135-6eb8-459f-9e09-d9df78cea212 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:11.018146 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-16ff2135-6eb8-459f-9e09-d9df78cea212 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:11.116612 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-bf445d27-650d-41cb-994a-eb245622ec6c tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:11.151033 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-bf445d27-650d-41cb-994a-eb245622ec6c tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2" status: 200 len: 1314 microversion: 2.1 time: 0.926214 Jan 15 02:41:11.167108 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 91/172] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:10 2021] GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2 => generated 1314 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:11.334770 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-965ce12c-b930-4429-a599-f02745db17ee tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:11.335573 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-965ce12c-b930-4429-a599-f02745db17ee tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:11.361885 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-965ce12c-b930-4429-a599-f02745db17ee tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:11.363290 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-965ce12c-b930-4429-a599-f02745db17ee tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:11.365352 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-965ce12c-b930-4429-a599-f02745db17ee tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:11.366844 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-965ce12c-b930-4429-a599-f02745db17ee tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:11.718282 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-965ce12c-b930-4429-a599-f02745db17ee tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:11.740828 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-965ce12c-b930-4429-a599-f02745db17ee tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1295 microversion: 2.1 time: 0.416038 Jan 15 02:41:11.742640 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 92/173] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:11 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1295 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:41:11.979778 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-eb4c5f6d-99d8-40c0-8152-97140d76f90a tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:11.982029 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-eb4c5f6d-99d8-40c0-8152-97140d76f90a tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] [instance: 9afd72bb-19e4-4afc-a01b-8c289d6a572b] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:12.000478 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eb4c5f6d-99d8-40c0-8152-97140d76f90a tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:12.001402 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eb4c5f6d-99d8-40c0-8152-97140d76f90a tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:12.003392 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eb4c5f6d-99d8-40c0-8152-97140d76f90a tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:12.004559 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eb4c5f6d-99d8-40c0-8152-97140d76f90a tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:12.385021 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-eb4c5f6d-99d8-40c0-8152-97140d76f90a tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b609b787be042b5bd55b9019a351a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b2895583774e1fb625c9bf7dac65b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:12.418112 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-eb4c5f6d-99d8-40c0-8152-97140d76f90a tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] 10.222.0.37 "GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b" status: 200 len: 1272 microversion: 2.1 time: 0.457942 Jan 15 02:41:12.419609 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 93/174] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:11 2021] GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b => generated 1272 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:12.448591 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-af8ec162-d4ea-40ac-ac06-3bd975d7bc29 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:12.450946 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-af8ec162-d4ea-40ac-ac06-3bd975d7bc29 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 10ed9ee0-28da-4fab-a4fc-3c52751013f2] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:12.469739 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-af8ec162-d4ea-40ac-ac06-3bd975d7bc29 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:12.471602 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-af8ec162-d4ea-40ac-ac06-3bd975d7bc29 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:12.474969 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-af8ec162-d4ea-40ac-ac06-3bd975d7bc29 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:12.476152 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-af8ec162-d4ea-40ac-ac06-3bd975d7bc29 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:13.143169 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-16ff2135-6eb8-459f-9e09-d9df78cea212 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:13.161069 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-16ff2135-6eb8-459f-9e09-d9df78cea212 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1522 microversion: 2.1 time: 2.215564 Jan 15 02:41:13.162945 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 82/175] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:10 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1522 bytes in 2219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:13.185610 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7283ea6a-293d-40e6-ad07-1b8769c653f2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:13.186477 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-7283ea6a-293d-40e6-ad07-1b8769c653f2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:13.198636 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7283ea6a-293d-40e6-ad07-1b8769c653f2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:13.199517 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7283ea6a-293d-40e6-ad07-1b8769c653f2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:13.200600 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7283ea6a-293d-40e6-ad07-1b8769c653f2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:13.201323 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7283ea6a-293d-40e6-ad07-1b8769c653f2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:13.624235 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-af8ec162-d4ea-40ac-ac06-3bd975d7bc29 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:13.644928 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-af8ec162-d4ea-40ac-ac06-3bd975d7bc29 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2" status: 200 len: 1314 microversion: 2.1 time: 1.221097 Jan 15 02:41:13.647577 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 94/176] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:12 2021] GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2 => generated 1314 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:13.673644 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-0d05bb56-d8c4-466d-8e51-6554620fbcc1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:13.675075 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-0d05bb56-d8c4-466d-8e51-6554620fbcc1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:13.699862 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0d05bb56-d8c4-466d-8e51-6554620fbcc1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:13.704984 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0d05bb56-d8c4-466d-8e51-6554620fbcc1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:13.709963 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0d05bb56-d8c4-466d-8e51-6554620fbcc1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:13.715077 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0d05bb56-d8c4-466d-8e51-6554620fbcc1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:13.943439 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.objects.instance [None req-0d05bb56-d8c4-466d-8e51-6554620fbcc1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lazy-loading 'flavor' on Instance uuid a8a86e56-4ee0-4098-98bb-7deac49ba1aa {{(pid=94111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Jan 15 02:41:14.407339 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-0d05bb56-d8c4-466d-8e51-6554620fbcc1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 202 len: 0 microversion: 2.20 time: 0.756660 Jan 15 02:41:14.421816 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 95/177] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:41:13 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 0 bytes in 773 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 15 02:41:14.465798 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-aa33c5c8-6625-4658-a81d-1d5e5dde457f tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:14.467428 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-aa33c5c8-6625-4658-a81d-1d5e5dde457f tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] [instance: 9afd72bb-19e4-4afc-a01b-8c289d6a572b] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:14.491408 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-aa33c5c8-6625-4658-a81d-1d5e5dde457f tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:14.492271 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-aa33c5c8-6625-4658-a81d-1d5e5dde457f tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:14.496038 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-aa33c5c8-6625-4658-a81d-1d5e5dde457f tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:14.497028 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-aa33c5c8-6625-4658-a81d-1d5e5dde457f tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:14.910552 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-aa33c5c8-6625-4658-a81d-1d5e5dde457f tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b609b787be042b5bd55b9019a351a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b2895583774e1fb625c9bf7dac65b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:14.921345 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-aa33c5c8-6625-4658-a81d-1d5e5dde457f tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] 10.222.0.37 "GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b" status: 200 len: 1272 microversion: 2.1 time: 0.495983 Jan 15 02:41:14.921997 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 96/178] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:14 2021] GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b => generated 1272 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:14.934217 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e258c0f8-923b-43a7-845c-c9d6893ab784 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:14.934768 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e258c0f8-923b-43a7-845c-c9d6893ab784 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:14.966572 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e258c0f8-923b-43a7-845c-c9d6893ab784 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:14.966572 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e258c0f8-923b-43a7-845c-c9d6893ab784 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:14.967280 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e258c0f8-923b-43a7-845c-c9d6893ab784 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:14.967945 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e258c0f8-923b-43a7-845c-c9d6893ab784 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:15.602958 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-7283ea6a-293d-40e6-ad07-1b8769c653f2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:15.610545 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e258c0f8-923b-43a7-845c-c9d6893ab784 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:15.622108 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-7283ea6a-293d-40e6-ad07-1b8769c653f2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1363 microversion: 2.1 time: 2.446428 Jan 15 02:41:15.630594 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e258c0f8-923b-43a7-845c-c9d6893ab784 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1522 microversion: 2.1 time: 0.706711 Jan 15 02:41:15.632531 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 97/179] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:14 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1522 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:15.646020 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 83/180] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:13 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1363 bytes in 2482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:15.659835 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7ea7484e-9349-42f5-9369-413dcd7e4015 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:15.661758 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-7ea7484e-9349-42f5-9369-413dcd7e4015 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:15.671267 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4d68288c-c29b-4ccb-a309-71da3d8f7e78 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:15.677085 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4d68288c-c29b-4ccb-a309-71da3d8f7e78 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 10ed9ee0-28da-4fab-a4fc-3c52751013f2] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:15.680933 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7ea7484e-9349-42f5-9369-413dcd7e4015 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:15.682416 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7ea7484e-9349-42f5-9369-413dcd7e4015 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:15.684777 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7ea7484e-9349-42f5-9369-413dcd7e4015 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:15.686203 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7ea7484e-9349-42f5-9369-413dcd7e4015 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:15.701427 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4d68288c-c29b-4ccb-a309-71da3d8f7e78 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:15.710124 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4d68288c-c29b-4ccb-a309-71da3d8f7e78 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:15.711578 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4d68288c-c29b-4ccb-a309-71da3d8f7e78 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:15.714213 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4d68288c-c29b-4ccb-a309-71da3d8f7e78 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:16.267036 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-7ea7484e-9349-42f5-9369-413dcd7e4015 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:16.337349 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-7ea7484e-9349-42f5-9369-413dcd7e4015 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:16.356741 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-7ea7484e-9349-42f5-9369-413dcd7e4015 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:16.360105 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-7ea7484e-9349-42f5-9369-413dcd7e4015 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1725 microversion: 2.20 time: 0.724458 Jan 15 02:41:16.361698 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 98/181] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:41:15 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1725 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:41:16.391024 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-7f2f7a66-273d-4775-9c8e-805b22ed2221 req-be6ef5b8-98c5-4e1d-838b-8bcfa4d850b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e38a45f-624e-4ca4-9f81-3d92ce319b50", "tag": "cb869005-2805-494c-8e3f-55bd108b2f03"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:16.408154 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:41:16.408154 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:41:16.425270 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-7f2f7a66-273d-4775-9c8e-805b22ed2221 req-be6ef5b8-98c5-4e1d-838b-8bcfa4d850b7 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:16.425772 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-7f2f7a66-273d-4775-9c8e-805b22ed2221 req-be6ef5b8-98c5-4e1d-838b-8bcfa4d850b7 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:16.498738 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-7f2f7a66-273d-4775-9c8e-805b22ed2221 req-be6ef5b8-98c5-4e1d-838b-8bcfa4d850b7 service nova] Creating event network-changed:cb869005-2805-494c-8e3f-55bd108b2f03 for instance 6e38a45f-624e-4ca4-9f81-3d92ce319b50 on hv-cinder-76330 Jan 15 02:41:16.505685 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-7f2f7a66-273d-4775-9c8e-805b22ed2221 req-be6ef5b8-98c5-4e1d-838b-8bcfa4d850b7 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140177 Jan 15 02:41:16.507704 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 99/182] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:41:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:41:16.543516 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f02868be-6041-4fc6-ad7c-b30987d85331 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:16.545036 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f02868be-6041-4fc6-ad7c-b30987d85331 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] [instance: 9afd72bb-19e4-4afc-a01b-8c289d6a572b] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:16.561983 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f02868be-6041-4fc6-ad7c-b30987d85331 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:16.563499 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f02868be-6041-4fc6-ad7c-b30987d85331 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:16.564919 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f02868be-6041-4fc6-ad7c-b30987d85331 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:16.566104 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f02868be-6041-4fc6-ad7c-b30987d85331 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:16.959826 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f02868be-6041-4fc6-ad7c-b30987d85331 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b609b787be042b5bd55b9019a351a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b2895583774e1fb625c9bf7dac65b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:17.016522 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f02868be-6041-4fc6-ad7c-b30987d85331 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] 10.222.0.37 "GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b" status: 200 len: 1272 microversion: 2.1 time: 0.499914 Jan 15 02:41:17.017082 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 100/183] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:16 2021] GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b => generated 1272 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:17.039042 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-88b18e67-773b-4928-9f34-b1ce1e060aaa req-495fa09a-d27d-4a7f-bf1e-d1f1c162b6d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10ed9ee0-28da-4fab-a4fc-3c52751013f2", "tag": "a88a90e6-0fd7-435e-b61b-ece1a8288f77"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:17.048385 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:41:17.048385 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:41:17.070738 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-88b18e67-773b-4928-9f34-b1ce1e060aaa req-495fa09a-d27d-4a7f-bf1e-d1f1c162b6d9 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:17.074692 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-88b18e67-773b-4928-9f34-b1ce1e060aaa req-495fa09a-d27d-4a7f-bf1e-d1f1c162b6d9 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:17.110138 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-88b18e67-773b-4928-9f34-b1ce1e060aaa req-495fa09a-d27d-4a7f-bf1e-d1f1c162b6d9 service nova] Creating event network-changed:a88a90e6-0fd7-435e-b61b-ece1a8288f77 for instance 10ed9ee0-28da-4fab-a4fc-3c52751013f2 on hv-cinder-76330 Jan 15 02:41:17.127727 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-88b18e67-773b-4928-9f34-b1ce1e060aaa req-495fa09a-d27d-4a7f-bf1e-d1f1c162b6d9 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109178 Jan 15 02:41:17.130239 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 101/184] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:41:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:41:17.157774 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4d68288c-c29b-4ccb-a309-71da3d8f7e78 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:17.185151 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-24365b08-4b70-4aa3-b567-a9fc27397df6 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:17.190080 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-24365b08-4b70-4aa3-b567-a9fc27397df6 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:17.211887 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-24365b08-4b70-4aa3-b567-a9fc27397df6 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:17.216402 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-24365b08-4b70-4aa3-b567-a9fc27397df6 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:17.219579 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-24365b08-4b70-4aa3-b567-a9fc27397df6 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:17.220651 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-24365b08-4b70-4aa3-b567-a9fc27397df6 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:17.235763 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4d68288c-c29b-4ccb-a309-71da3d8f7e78 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2" status: 200 len: 1314 microversion: 2.1 time: 1.581535 Jan 15 02:41:17.237706 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 84/185] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:15 2021] GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2 => generated 1314 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:17.291888 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7b217fd8-8c12-477f-b4dc-b556eaa296dc tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:17.295499 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-7b217fd8-8c12-477f-b4dc-b556eaa296dc tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:17.327901 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7b217fd8-8c12-477f-b4dc-b556eaa296dc tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:17.329779 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7b217fd8-8c12-477f-b4dc-b556eaa296dc tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:17.331795 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7b217fd8-8c12-477f-b4dc-b556eaa296dc tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:17.332911 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7b217fd8-8c12-477f-b4dc-b556eaa296dc tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:18.383557 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-7b217fd8-8c12-477f-b4dc-b556eaa296dc tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:18.395143 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-7b217fd8-8c12-477f-b4dc-b556eaa296dc tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1363 microversion: 2.1 time: 1.155433 Jan 15 02:41:18.396491 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 85/186] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:17 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1363 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:18.408743 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f5440e68-6ce4-4e39-a9c5-32396fd60c56 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:18.409863 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f5440e68-6ce4-4e39-a9c5-32396fd60c56 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:18.422979 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-24365b08-4b70-4aa3-b567-a9fc27397df6 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:18.425046 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f5440e68-6ce4-4e39-a9c5-32396fd60c56 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:18.425849 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f5440e68-6ce4-4e39-a9c5-32396fd60c56 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:18.426970 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f5440e68-6ce4-4e39-a9c5-32396fd60c56 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:18.432543 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f5440e68-6ce4-4e39-a9c5-32396fd60c56 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:18.460968 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-24365b08-4b70-4aa3-b567-a9fc27397df6 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1522 microversion: 2.1 time: 1.328921 Jan 15 02:41:18.474234 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 102/187] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:17 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1522 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:18.514072 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3b1a90e8-aa8e-4b39-a5d6-59cbdf4c85e0 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:18.518614 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3b1a90e8-aa8e-4b39-a5d6-59cbdf4c85e0 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] [instance: 9afd72bb-19e4-4afc-a01b-8c289d6a572b] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:18.560120 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3b1a90e8-aa8e-4b39-a5d6-59cbdf4c85e0 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:18.561155 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3b1a90e8-aa8e-4b39-a5d6-59cbdf4c85e0 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:18.562867 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3b1a90e8-aa8e-4b39-a5d6-59cbdf4c85e0 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:18.564154 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3b1a90e8-aa8e-4b39-a5d6-59cbdf4c85e0 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:19.298365 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f5440e68-6ce4-4e39-a9c5-32396fd60c56 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:19.316229 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f5440e68-6ce4-4e39-a9c5-32396fd60c56 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:19.323652 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f5440e68-6ce4-4e39-a9c5-32396fd60c56 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:19.325306 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f5440e68-6ce4-4e39-a9c5-32396fd60c56 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1725 microversion: 2.20 time: 0.926976 Jan 15 02:41:19.326218 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 86/188] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:41:18 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1725 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:41:19.336598 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-715e77a3-c411-46e5-927f-4b9016cca126 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:19.338401 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-715e77a3-c411-46e5-927f-4b9016cca126 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 10ed9ee0-28da-4fab-a4fc-3c52751013f2] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:19.346793 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-715e77a3-c411-46e5-927f-4b9016cca126 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:19.347649 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-715e77a3-c411-46e5-927f-4b9016cca126 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:19.348729 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-715e77a3-c411-46e5-927f-4b9016cca126 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:19.349518 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-715e77a3-c411-46e5-927f-4b9016cca126 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:19.561987 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3b1a90e8-aa8e-4b39-a5d6-59cbdf4c85e0 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b609b787be042b5bd55b9019a351a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b2895583774e1fb625c9bf7dac65b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:19.574637 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3b1a90e8-aa8e-4b39-a5d6-59cbdf4c85e0 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] 10.222.0.37 "GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b" status: 200 len: 1314 microversion: 2.1 time: 1.098320 Jan 15 02:41:19.575634 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 103/189] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:18 2021] GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b => generated 1314 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:19.606138 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f4955382-2e00-44f1-8748-16afeacaf4d4 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:19.606826 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f4955382-2e00-44f1-8748-16afeacaf4d4 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:19.615120 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f4955382-2e00-44f1-8748-16afeacaf4d4 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:19.615599 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f4955382-2e00-44f1-8748-16afeacaf4d4 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:19.616638 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f4955382-2e00-44f1-8748-16afeacaf4d4 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:19.617855 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f4955382-2e00-44f1-8748-16afeacaf4d4 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:20.453086 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f4955382-2e00-44f1-8748-16afeacaf4d4 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:20.472509 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f4955382-2e00-44f1-8748-16afeacaf4d4 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1363 microversion: 2.1 time: 0.894953 Jan 15 02:41:20.473943 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 104/190] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:19 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1363 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:20.514907 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c836e8f7-0cf2-4068-bf73-c4bd3aab57d9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:20.516863 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c836e8f7-0cf2-4068-bf73-c4bd3aab57d9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:20.534633 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c836e8f7-0cf2-4068-bf73-c4bd3aab57d9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:20.535557 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c836e8f7-0cf2-4068-bf73-c4bd3aab57d9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:20.542910 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c836e8f7-0cf2-4068-bf73-c4bd3aab57d9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:20.543865 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c836e8f7-0cf2-4068-bf73-c4bd3aab57d9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:21.406780 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-715e77a3-c411-46e5-927f-4b9016cca126 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:21.432294 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-715e77a3-c411-46e5-927f-4b9016cca126 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2" status: 200 len: 1314 microversion: 2.1 time: 2.103945 Jan 15 02:41:21.433450 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 87/191] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:19 2021] GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2 => generated 1314 bytes in 2106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:21.444767 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6c298ae4-c7ba-4ebd-95b3-d9d117444d1e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:21.445877 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6c298ae4-c7ba-4ebd-95b3-d9d117444d1e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:21.460818 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6c298ae4-c7ba-4ebd-95b3-d9d117444d1e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:21.462394 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6c298ae4-c7ba-4ebd-95b3-d9d117444d1e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:21.463955 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6c298ae4-c7ba-4ebd-95b3-d9d117444d1e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:21.475331 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6c298ae4-c7ba-4ebd-95b3-d9d117444d1e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:21.496797 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c836e8f7-0cf2-4068-bf73-c4bd3aab57d9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:21.554600 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c836e8f7-0cf2-4068-bf73-c4bd3aab57d9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1522 microversion: 2.1 time: 1.069998 Jan 15 02:41:21.554600 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 105/192] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:20 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1522 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:21.569423 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-afc9f93a-784e-4f11-97b5-8b490789816c tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:21.570110 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-afc9f93a-784e-4f11-97b5-8b490789816c tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] [instance: 9afd72bb-19e4-4afc-a01b-8c289d6a572b] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:21.589615 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-afc9f93a-784e-4f11-97b5-8b490789816c tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:21.589615 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-afc9f93a-784e-4f11-97b5-8b490789816c tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:21.589615 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-afc9f93a-784e-4f11-97b5-8b490789816c tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:21.589615 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-afc9f93a-784e-4f11-97b5-8b490789816c tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:22.064089 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-afc9f93a-784e-4f11-97b5-8b490789816c tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b609b787be042b5bd55b9019a351a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b2895583774e1fb625c9bf7dac65b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:22.076429 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-afc9f93a-784e-4f11-97b5-8b490789816c tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] 10.222.0.37 "GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b" status: 200 len: 1314 microversion: 2.1 time: 0.517119 Jan 15 02:41:22.085062 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 106/193] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:21 2021] GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:22.108705 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-df89f160-b849-431c-9ba1-4b88a2b11594 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:22.109936 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-df89f160-b849-431c-9ba1-4b88a2b11594 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:22.124578 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-df89f160-b849-431c-9ba1-4b88a2b11594 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:22.125220 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-df89f160-b849-431c-9ba1-4b88a2b11594 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:22.126487 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-df89f160-b849-431c-9ba1-4b88a2b11594 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:22.127405 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-df89f160-b849-431c-9ba1-4b88a2b11594 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:22.711405 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-df89f160-b849-431c-9ba1-4b88a2b11594 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:22.755915 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-df89f160-b849-431c-9ba1-4b88a2b11594 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1363 microversion: 2.1 time: 0.666195 Jan 15 02:41:22.757247 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 107/194] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:22 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1363 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:22.795857 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-012360a0-646e-4716-a2b2-c233a8f7d389 req-20c17ce4-7721-4529-bf98-7cc57dd4fb9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e38a45f-624e-4ca4-9f81-3d92ce319b50", "name": "network-vif-plugged", "status": "completed", "tag": "cb869005-2805-494c-8e3f-55bd108b2f03"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:22.812832 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:41:22.812832 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:41:22.827734 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-012360a0-646e-4716-a2b2-c233a8f7d389 req-20c17ce4-7721-4529-bf98-7cc57dd4fb9c service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:22.828894 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-012360a0-646e-4716-a2b2-c233a8f7d389 req-20c17ce4-7721-4529-bf98-7cc57dd4fb9c service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:22.863513 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-012360a0-646e-4716-a2b2-c233a8f7d389 req-20c17ce4-7721-4529-bf98-7cc57dd4fb9c service nova] Creating event network-vif-plugged:cb869005-2805-494c-8e3f-55bd108b2f03 for instance 6e38a45f-624e-4ca4-9f81-3d92ce319b50 on hv-cinder-76330 Jan 15 02:41:22.874243 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-012360a0-646e-4716-a2b2-c233a8f7d389 req-20c17ce4-7721-4529-bf98-7cc57dd4fb9c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098693 Jan 15 02:41:22.876096 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 108/195] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:41:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:41:22.899444 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-74ef6ac9-3e7f-435a-b791-153de93f38b8 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:22.901920 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-74ef6ac9-3e7f-435a-b791-153de93f38b8 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 10ed9ee0-28da-4fab-a4fc-3c52751013f2] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:22.929159 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-74ef6ac9-3e7f-435a-b791-153de93f38b8 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:22.929835 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-74ef6ac9-3e7f-435a-b791-153de93f38b8 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:22.930727 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-74ef6ac9-3e7f-435a-b791-153de93f38b8 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:22.945613 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-74ef6ac9-3e7f-435a-b791-153de93f38b8 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:22.999595 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6c298ae4-c7ba-4ebd-95b3-d9d117444d1e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:23.035904 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6c298ae4-c7ba-4ebd-95b3-d9d117444d1e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:23.055236 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6c298ae4-c7ba-4ebd-95b3-d9d117444d1e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:23.057385 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6c298ae4-c7ba-4ebd-95b3-d9d117444d1e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1725 microversion: 2.20 time: 1.622191 Jan 15 02:41:23.058128 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 88/196] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:41:21 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1725 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:41:23.069497 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c40e765b-aa43-4cbf-bc75-2ce17d45cb8a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:23.083763 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c40e765b-aa43-4cbf-bc75-2ce17d45cb8a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:23.095258 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c40e765b-aa43-4cbf-bc75-2ce17d45cb8a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:23.095783 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c40e765b-aa43-4cbf-bc75-2ce17d45cb8a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:23.096729 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c40e765b-aa43-4cbf-bc75-2ce17d45cb8a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:23.097353 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c40e765b-aa43-4cbf-bc75-2ce17d45cb8a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:23.697932 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-74ef6ac9-3e7f-435a-b791-153de93f38b8 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:23.736730 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-74ef6ac9-3e7f-435a-b791-153de93f38b8 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2" status: 200 len: 1314 microversion: 2.1 time: 0.858360 Jan 15 02:41:23.740980 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 109/197] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:22 2021] GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2 => generated 1314 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:23.797575 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-866da6a2-d76d-4fcc-964f-7107f14d1780 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:23.820119 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-866da6a2-d76d-4fcc-964f-7107f14d1780 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] [instance: 9afd72bb-19e4-4afc-a01b-8c289d6a572b] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:23.840217 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-866da6a2-d76d-4fcc-964f-7107f14d1780 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:23.840615 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-866da6a2-d76d-4fcc-964f-7107f14d1780 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:23.841575 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-866da6a2-d76d-4fcc-964f-7107f14d1780 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:23.842076 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-866da6a2-d76d-4fcc-964f-7107f14d1780 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:24.133921 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c40e765b-aa43-4cbf-bc75-2ce17d45cb8a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:24.145340 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c40e765b-aa43-4cbf-bc75-2ce17d45cb8a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1502 microversion: 2.1 time: 1.085829 Jan 15 02:41:24.147364 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 89/198] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:23 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1502 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:24.167413 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-92ca13e3-6e2a-40ab-970c-56aecf7b6819 req-34d8ff8f-67ab-4274-8f4a-81db73a34674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9afd72bb-19e4-4afc-a01b-8c289d6a572b", "tag": "5ee1a130-1756-4325-b512-c82fc07e9cbf"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:24.175789 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:41:24.175789 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:41:24.188151 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-92ca13e3-6e2a-40ab-970c-56aecf7b6819 req-34d8ff8f-67ab-4274-8f4a-81db73a34674 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:24.188727 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-92ca13e3-6e2a-40ab-970c-56aecf7b6819 req-34d8ff8f-67ab-4274-8f4a-81db73a34674 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:24.209591 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-92ca13e3-6e2a-40ab-970c-56aecf7b6819 req-34d8ff8f-67ab-4274-8f4a-81db73a34674 service nova] Creating event network-changed:5ee1a130-1756-4325-b512-c82fc07e9cbf for instance 9afd72bb-19e4-4afc-a01b-8c289d6a572b on hv-cinder-76330 Jan 15 02:41:24.216158 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-92ca13e3-6e2a-40ab-970c-56aecf7b6819 req-34d8ff8f-67ab-4274-8f4a-81db73a34674 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067120 Jan 15 02:41:24.216826 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 90/199] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:41:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:41:24.230271 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d83a95a7-405f-4b97-b73f-18332352fe37 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:24.231385 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d83a95a7-405f-4b97-b73f-18332352fe37 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:24.240219 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d83a95a7-405f-4b97-b73f-18332352fe37 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:24.240834 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d83a95a7-405f-4b97-b73f-18332352fe37 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:24.242122 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d83a95a7-405f-4b97-b73f-18332352fe37 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:24.242697 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d83a95a7-405f-4b97-b73f-18332352fe37 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:24.292479 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-866da6a2-d76d-4fcc-964f-7107f14d1780 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b609b787be042b5bd55b9019a351a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b2895583774e1fb625c9bf7dac65b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:24.303298 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-866da6a2-d76d-4fcc-964f-7107f14d1780 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] 10.222.0.37 "GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b" status: 200 len: 1314 microversion: 2.1 time: 0.557903 Jan 15 02:41:24.303778 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 110/200] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:23 2021] GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:24.332626 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-94baa72e-448e-4a7a-9898-732ac852a0b2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:24.333968 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-94baa72e-448e-4a7a-9898-732ac852a0b2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:24.351112 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-94baa72e-448e-4a7a-9898-732ac852a0b2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:24.352046 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-94baa72e-448e-4a7a-9898-732ac852a0b2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:24.354405 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-94baa72e-448e-4a7a-9898-732ac852a0b2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:24.355324 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-94baa72e-448e-4a7a-9898-732ac852a0b2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:24.683582 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-94baa72e-448e-4a7a-9898-732ac852a0b2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:24.700766 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-94baa72e-448e-4a7a-9898-732ac852a0b2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:24.708171 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-94baa72e-448e-4a7a-9898-732ac852a0b2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:24.709631 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-94baa72e-448e-4a7a-9898-732ac852a0b2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1725 microversion: 2.20 time: 0.401212 Jan 15 02:41:24.710326 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 111/201] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:41:24 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1725 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:41:24.724217 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f6dc0780-e4a9-495a-a2ca-918cad25f147 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62de8f7b-d792-4d64-ba7d-24c5f5304996"}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:24.726138 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f6dc0780-e4a9-495a-a2ca-918cad25f147 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:24.737534 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f6dc0780-e4a9-495a-a2ca-918cad25f147 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:24.737534 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f6dc0780-e4a9-495a-a2ca-918cad25f147 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:24.738292 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f6dc0780-e4a9-495a-a2ca-918cad25f147 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:24.738788 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f6dc0780-e4a9-495a-a2ca-918cad25f147 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:24.823240 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-f6dc0780-e4a9-495a-a2ca-918cad25f147 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] HTTP exception thrown: Cannot 'attach_volume' instance e90ce195-f423-416c-859f-a6423d99efe6 while it is in vm_state rescued Jan 15 02:41:24.824517 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f6dc0780-e4a9-495a-a2ca-918cad25f147 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Returning 409 to user: Cannot 'attach_volume' instance e90ce195-f423-416c-859f-a6423d99efe6 while it is in vm_state rescued {{(pid=94111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:41:24.825536 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f6dc0780-e4a9-495a-a2ca-918cad25f147 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "POST /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.113830 Jan 15 02:41:24.831868 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 112/202] 10.222.0.37 () {60 vars in 1313 bytes} [Fri Jan 15 02:41:24 2021] POST /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6/os-volume_attachments => generated 152 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 15 02:41:24.836822 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-cbb9231c-8225-44e6-bbe7-5f5b85b64a26 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:24.838169 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-cbb9231c-8225-44e6-bbe7-5f5b85b64a26 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 10ed9ee0-28da-4fab-a4fc-3c52751013f2] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:24.847339 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cbb9231c-8225-44e6-bbe7-5f5b85b64a26 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:24.848276 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cbb9231c-8225-44e6-bbe7-5f5b85b64a26 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:24.848714 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cbb9231c-8225-44e6-bbe7-5f5b85b64a26 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:24.849253 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cbb9231c-8225-44e6-bbe7-5f5b85b64a26 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:24.945714 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d83a95a7-405f-4b97-b73f-18332352fe37 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:24.967570 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d83a95a7-405f-4b97-b73f-18332352fe37 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1363 microversion: 2.1 time: 0.749115 Jan 15 02:41:24.968338 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 91/203] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:24 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1363 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:24.992832 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4324800b-5aa5-49cc-9cf4-cc491d3a0707 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:24.997482 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4324800b-5aa5-49cc-9cf4-cc491d3a0707 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:25.011543 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4324800b-5aa5-49cc-9cf4-cc491d3a0707 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:25.012025 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4324800b-5aa5-49cc-9cf4-cc491d3a0707 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:25.014294 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4324800b-5aa5-49cc-9cf4-cc491d3a0707 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:25.021172 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4324800b-5aa5-49cc-9cf4-cc491d3a0707 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:25.293163 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-cbb9231c-8225-44e6-bbe7-5f5b85b64a26 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:25.304567 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-cbb9231c-8225-44e6-bbe7-5f5b85b64a26 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2" status: 200 len: 1314 microversion: 2.1 time: 0.477182 Jan 15 02:41:25.305613 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 113/204] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:24 2021] GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:25.317785 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-b7cddd5f-07b5-49c2-b621-415d09a90ca7 req-9d299911-f752-410c-9320-c70a51f3910d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ed9ee0-28da-4fab-a4fc-3c52751013f2", "name": "network-vif-plugged", "status": "completed", "tag": "a88a90e6-0fd7-435e-b61b-ece1a8288f77"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:25.326423 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:41:25.326423 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:41:25.336280 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-b7cddd5f-07b5-49c2-b621-415d09a90ca7 req-9d299911-f752-410c-9320-c70a51f3910d service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:25.337715 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-b7cddd5f-07b5-49c2-b621-415d09a90ca7 req-9d299911-f752-410c-9320-c70a51f3910d service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:25.372051 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-b7cddd5f-07b5-49c2-b621-415d09a90ca7 req-9d299911-f752-410c-9320-c70a51f3910d service nova] Creating event network-vif-plugged:a88a90e6-0fd7-435e-b61b-ece1a8288f77 for instance 10ed9ee0-28da-4fab-a4fc-3c52751013f2 on hv-cinder-76330 Jan 15 02:41:25.381738 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-b7cddd5f-07b5-49c2-b621-415d09a90ca7 req-9d299911-f752-410c-9320-c70a51f3910d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073291 Jan 15 02:41:25.386347 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 114/205] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:41:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:41:25.393229 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4324800b-5aa5-49cc-9cf4-cc491d3a0707 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "POST /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6/action" status: 202 len: 0 microversion: 2.1 time: 0.423212 Jan 15 02:41:25.394182 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 92/206] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:41:24 2021] POST /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6/action => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:41:25.427086 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f9671dd4-6734-4c0d-926b-33573b3c8f5d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:25.441203 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f9671dd4-6734-4c0d-926b-33573b3c8f5d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:25.450351 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a6ed38fa-2659-4673-8023-feb00744ace7 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:25.462011 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a6ed38fa-2659-4673-8023-feb00744ace7 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] [instance: 9afd72bb-19e4-4afc-a01b-8c289d6a572b] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:25.470461 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f9671dd4-6734-4c0d-926b-33573b3c8f5d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:25.473598 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f9671dd4-6734-4c0d-926b-33573b3c8f5d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:25.474797 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f9671dd4-6734-4c0d-926b-33573b3c8f5d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:25.475495 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f9671dd4-6734-4c0d-926b-33573b3c8f5d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:25.495755 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a6ed38fa-2659-4673-8023-feb00744ace7 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:25.498304 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a6ed38fa-2659-4673-8023-feb00744ace7 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:25.499796 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a6ed38fa-2659-4673-8023-feb00744ace7 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:25.500771 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a6ed38fa-2659-4673-8023-feb00744ace7 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:26.348592 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f9671dd4-6734-4c0d-926b-33573b3c8f5d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:26.361491 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f9671dd4-6734-4c0d-926b-33573b3c8f5d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1510 microversion: 2.1 time: 0.959338 Jan 15 02:41:26.362877 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 93/207] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:25 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1510 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:26.377144 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f877479f-0371-423f-b752-02c163906c5e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:26.378120 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f877479f-0371-423f-b752-02c163906c5e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:26.388028 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f877479f-0371-423f-b752-02c163906c5e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:26.388741 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f877479f-0371-423f-b752-02c163906c5e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:26.389642 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f877479f-0371-423f-b752-02c163906c5e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:26.390352 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f877479f-0371-423f-b752-02c163906c5e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:26.487451 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a6ed38fa-2659-4673-8023-feb00744ace7 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b609b787be042b5bd55b9019a351a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b2895583774e1fb625c9bf7dac65b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:26.507762 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a6ed38fa-2659-4673-8023-feb00744ace7 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] 10.222.0.37 "GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b" status: 200 len: 1314 microversion: 2.1 time: 1.119323 Jan 15 02:41:26.509510 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 115/208] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:25 2021] GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b => generated 1314 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:26.534233 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-83155379-f11b-4118-b709-6140bfb74288 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:26.535456 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-83155379-f11b-4118-b709-6140bfb74288 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:26.555578 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-83155379-f11b-4118-b709-6140bfb74288 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:26.557212 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-83155379-f11b-4118-b709-6140bfb74288 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:26.558862 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-83155379-f11b-4118-b709-6140bfb74288 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:26.559794 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-83155379-f11b-4118-b709-6140bfb74288 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:27.323794 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f877479f-0371-423f-b752-02c163906c5e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:27.339894 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f877479f-0371-423f-b752-02c163906c5e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:27.347389 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f877479f-0371-423f-b752-02c163906c5e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:27.348746 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f877479f-0371-423f-b752-02c163906c5e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1725 microversion: 2.20 time: 0.984293 Jan 15 02:41:27.349450 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 94/209] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:41:26 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1725 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:41:27.360357 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1728a966-0a2f-4e8f-ab53-4c1c84623de8 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:27.361339 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1728a966-0a2f-4e8f-ab53-4c1c84623de8 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 10ed9ee0-28da-4fab-a4fc-3c52751013f2] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:27.370880 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1728a966-0a2f-4e8f-ab53-4c1c84623de8 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:27.371751 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1728a966-0a2f-4e8f-ab53-4c1c84623de8 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:27.372789 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1728a966-0a2f-4e8f-ab53-4c1c84623de8 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:27.373368 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1728a966-0a2f-4e8f-ab53-4c1c84623de8 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:27.669141 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-83155379-f11b-4118-b709-6140bfb74288 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:27.696741 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-83155379-f11b-4118-b709-6140bfb74288 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1550 microversion: 2.1 time: 1.184677 Jan 15 02:41:27.697864 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 116/210] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:26 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1550 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:27.748645 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-0852c866-0a63-4516-8629-69ebe2aa3688 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:27.750561 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-0852c866-0a63-4516-8629-69ebe2aa3688 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:27.768298 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0852c866-0a63-4516-8629-69ebe2aa3688 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:27.769506 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0852c866-0a63-4516-8629-69ebe2aa3688 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:27.771325 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0852c866-0a63-4516-8629-69ebe2aa3688 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:27.772647 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0852c866-0a63-4516-8629-69ebe2aa3688 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:27.936113 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1728a966-0a2f-4e8f-ab53-4c1c84623de8 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:27.955807 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1728a966-0a2f-4e8f-ab53-4c1c84623de8 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2" status: 200 len: 1314 microversion: 2.1 time: 0.604764 Jan 15 02:41:27.957491 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 95/211] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:27 2021] GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2 => generated 1314 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:28.002311 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5d44f087-511c-47ab-8e9e-3ada99d32486 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:28.014590 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5d44f087-511c-47ab-8e9e-3ada99d32486 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] [instance: 9afd72bb-19e4-4afc-a01b-8c289d6a572b] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:28.040325 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5d44f087-511c-47ab-8e9e-3ada99d32486 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:28.041758 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5d44f087-511c-47ab-8e9e-3ada99d32486 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:28.048723 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5d44f087-511c-47ab-8e9e-3ada99d32486 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:28.050634 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5d44f087-511c-47ab-8e9e-3ada99d32486 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:28.439320 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0852c866-0a63-4516-8629-69ebe2aa3688 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:28.449541 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-0852c866-0a63-4516-8629-69ebe2aa3688 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1510 microversion: 2.1 time: 0.737783 Jan 15 02:41:28.450514 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 117/212] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:27 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1510 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:28.461127 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-597bc1f7-eaf4-4368-b794-8e4b1224e4c5 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:28.461686 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-597bc1f7-eaf4-4368-b794-8e4b1224e4c5 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:28.470482 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-597bc1f7-eaf4-4368-b794-8e4b1224e4c5 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:28.471000 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-597bc1f7-eaf4-4368-b794-8e4b1224e4c5 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:28.472269 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-597bc1f7-eaf4-4368-b794-8e4b1224e4c5 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:28.472467 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-597bc1f7-eaf4-4368-b794-8e4b1224e4c5 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:28.682041 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-5d44f087-511c-47ab-8e9e-3ada99d32486 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b609b787be042b5bd55b9019a351a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b2895583774e1fb625c9bf7dac65b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:28.696549 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5d44f087-511c-47ab-8e9e-3ada99d32486 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] 10.222.0.37 "GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b" status: 200 len: 1314 microversion: 2.1 time: 0.721134 Jan 15 02:41:28.697494 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 96/213] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:27 2021] GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b => generated 1314 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:28.709645 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a0bf1c8a-c473-4e9c-812e-d382fc72c3ca tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:28.710579 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a0bf1c8a-c473-4e9c-812e-d382fc72c3ca tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:28.719905 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a0bf1c8a-c473-4e9c-812e-d382fc72c3ca tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:28.720842 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a0bf1c8a-c473-4e9c-812e-d382fc72c3ca tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:28.721943 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a0bf1c8a-c473-4e9c-812e-d382fc72c3ca tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:28.722677 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a0bf1c8a-c473-4e9c-812e-d382fc72c3ca tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:29.063145 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a0bf1c8a-c473-4e9c-812e-d382fc72c3ca tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:29.079082 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a0bf1c8a-c473-4e9c-812e-d382fc72c3ca tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:29.086132 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a0bf1c8a-c473-4e9c-812e-d382fc72c3ca tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:29.088305 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a0bf1c8a-c473-4e9c-812e-d382fc72c3ca tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1725 microversion: 2.20 time: 0.389226 Jan 15 02:41:29.088695 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 97/214] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:41:28 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1725 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:41:29.099154 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-786c6633-79c5-48d5-b9b8-f62b3da1e298 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:29.099825 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-786c6633-79c5-48d5-b9b8-f62b3da1e298 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 10ed9ee0-28da-4fab-a4fc-3c52751013f2] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:29.109485 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-786c6633-79c5-48d5-b9b8-f62b3da1e298 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:29.109995 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-786c6633-79c5-48d5-b9b8-f62b3da1e298 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:29.110899 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-786c6633-79c5-48d5-b9b8-f62b3da1e298 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:29.111388 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-786c6633-79c5-48d5-b9b8-f62b3da1e298 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:29.380148 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-597bc1f7-eaf4-4368-b794-8e4b1224e4c5 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.928302 Jan 15 02:41:29.380799 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 118/215] 10.222.0.37 () {58 vars in 1265 bytes} [Fri Jan 15 02:41:28 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/os-interface => generated 285 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:41:29.476033 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f1947ce8-37b6-43bd-bdb3-4c85c505fcfd tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:29.476828 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f1947ce8-37b6-43bd-bdb3-4c85c505fcfd tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:29.494576 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f1947ce8-37b6-43bd-bdb3-4c85c505fcfd tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:29.495111 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f1947ce8-37b6-43bd-bdb3-4c85c505fcfd tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:29.496133 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f1947ce8-37b6-43bd-bdb3-4c85c505fcfd tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:29.496679 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f1947ce8-37b6-43bd-bdb3-4c85c505fcfd tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:29.831871 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-786c6633-79c5-48d5-b9b8-f62b3da1e298 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:29.852341 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-786c6633-79c5-48d5-b9b8-f62b3da1e298 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2" status: 200 len: 1498 microversion: 2.1 time: 0.762066 Jan 15 02:41:29.854991 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 98/216] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:29 2021] GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2 => generated 1498 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:29.880272 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a608704c-c8c8-4eed-b114-7550dbfd7dd5 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:29.881587 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a608704c-c8c8-4eed-b114-7550dbfd7dd5 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] [instance: 9afd72bb-19e4-4afc-a01b-8c289d6a572b] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:29.901238 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a608704c-c8c8-4eed-b114-7550dbfd7dd5 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:29.902232 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a608704c-c8c8-4eed-b114-7550dbfd7dd5 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:29.903755 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a608704c-c8c8-4eed-b114-7550dbfd7dd5 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:29.904614 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a608704c-c8c8-4eed-b114-7550dbfd7dd5 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:30.403675 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a608704c-c8c8-4eed-b114-7550dbfd7dd5 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b609b787be042b5bd55b9019a351a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b2895583774e1fb625c9bf7dac65b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:30.423271 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a608704c-c8c8-4eed-b114-7550dbfd7dd5 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] 10.222.0.37 "GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b" status: 200 len: 1314 microversion: 2.1 time: 0.566132 Jan 15 02:41:30.424508 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 99/217] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:29 2021] GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:30.445343 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4d26a71d-ba2c-41bc-9d0c-2f8c5accfc78 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:30.447046 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4d26a71d-ba2c-41bc-9d0c-2f8c5accfc78 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:30.457375 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4d26a71d-ba2c-41bc-9d0c-2f8c5accfc78 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:30.457896 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4d26a71d-ba2c-41bc-9d0c-2f8c5accfc78 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:30.458803 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4d26a71d-ba2c-41bc-9d0c-2f8c5accfc78 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:30.459301 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4d26a71d-ba2c-41bc-9d0c-2f8c5accfc78 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:30.763145 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4d26a71d-ba2c-41bc-9d0c-2f8c5accfc78 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:30.791357 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4d26a71d-ba2c-41bc-9d0c-2f8c5accfc78 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:30.799536 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4d26a71d-ba2c-41bc-9d0c-2f8c5accfc78 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:30.801483 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4d26a71d-ba2c-41bc-9d0c-2f8c5accfc78 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1746 microversion: 2.20 time: 0.367549 Jan 15 02:41:30.802598 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 100/218] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:41:30 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1746 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:41:30.811202 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f1947ce8-37b6-43bd-bdb3-4c85c505fcfd tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:30.822670 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f1947ce8-37b6-43bd-bdb3-4c85c505fcfd tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1510 microversion: 2.1 time: 1.356993 Jan 15 02:41:30.824122 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 119/219] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:29 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1510 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:41:31.406378 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c8cd4ff8-2f38-4311-bd72-42a364bf09fb tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:31.406944 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c8cd4ff8-2f38-4311-bd72-42a364bf09fb tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 10ed9ee0-28da-4fab-a4fc-3c52751013f2] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:31.420033 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c8cd4ff8-2f38-4311-bd72-42a364bf09fb tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:31.420972 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c8cd4ff8-2f38-4311-bd72-42a364bf09fb tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:31.422603 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c8cd4ff8-2f38-4311-bd72-42a364bf09fb tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:31.423493 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c8cd4ff8-2f38-4311-bd72-42a364bf09fb tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:31.491549 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-77182371-bde5-4abf-af9d-1c83b716e075 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:31.492861 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-77182371-bde5-4abf-af9d-1c83b716e075 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] [instance: 9afd72bb-19e4-4afc-a01b-8c289d6a572b] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:31.531892 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-77182371-bde5-4abf-af9d-1c83b716e075 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:31.532846 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-77182371-bde5-4abf-af9d-1c83b716e075 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:31.539736 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-77182371-bde5-4abf-af9d-1c83b716e075 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:31.541467 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-77182371-bde5-4abf-af9d-1c83b716e075 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:31.720766 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c8cd4ff8-2f38-4311-bd72-42a364bf09fb tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 10ed9ee0-28da-4fab-a4fc-3c52751013f2] Going to try to terminate instance {{(pid=94112) delete /opt/stack/nova/nova/compute/api.py:2535}} Jan 15 02:41:31.977354 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c8cd4ff8-2f38-4311-bd72-42a364bf09fb tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "DELETE /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2" status: 204 len: 0 microversion: 2.1 time: 0.580953 Jan 15 02:41:31.994156 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 101/220] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:41:31 2021] DELETE /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 02:41:32.013756 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-0a49ce82-e874-4dd8-b4a5-51e606be11f1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:32.016859 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-0a49ce82-e874-4dd8-b4a5-51e606be11f1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:32.045434 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0a49ce82-e874-4dd8-b4a5-51e606be11f1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:32.046498 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0a49ce82-e874-4dd8-b4a5-51e606be11f1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:32.047628 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0a49ce82-e874-4dd8-b4a5-51e606be11f1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:32.048328 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0a49ce82-e874-4dd8-b4a5-51e606be11f1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:32.693700 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-77182371-bde5-4abf-af9d-1c83b716e075 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b609b787be042b5bd55b9019a351a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b2895583774e1fb625c9bf7dac65b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:32.726637 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-77182371-bde5-4abf-af9d-1c83b716e075 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] 10.222.0.37 "GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b" status: 200 len: 1314 microversion: 2.1 time: 1.265719 Jan 15 02:41:32.727742 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 120/221] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:31 2021] GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b => generated 1314 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:32.751991 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9ae56261-15b9-4604-bb25-64ecd94b4cbb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:32.752974 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9ae56261-15b9-4604-bb25-64ecd94b4cbb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:32.763084 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9ae56261-15b9-4604-bb25-64ecd94b4cbb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:32.763973 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9ae56261-15b9-4604-bb25-64ecd94b4cbb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:32.765358 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9ae56261-15b9-4604-bb25-64ecd94b4cbb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:32.766081 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9ae56261-15b9-4604-bb25-64ecd94b4cbb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:32.971611 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0a49ce82-e874-4dd8-b4a5-51e606be11f1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:33.004398 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0a49ce82-e874-4dd8-b4a5-51e606be11f1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:33.013758 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0a49ce82-e874-4dd8-b4a5-51e606be11f1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:33.015209 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-0a49ce82-e874-4dd8-b4a5-51e606be11f1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1746 microversion: 2.20 time: 1.019322 Jan 15 02:41:33.016268 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 102/222] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:41:31 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1746 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:41:33.033626 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-49f17824-f424-470f-b899-a6a100f47ba7 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:33.034695 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-49f17824-f424-470f-b899-a6a100f47ba7 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 10ed9ee0-28da-4fab-a4fc-3c52751013f2] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:33.046203 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-49f17824-f424-470f-b899-a6a100f47ba7 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:33.047227 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-49f17824-f424-470f-b899-a6a100f47ba7 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:33.048425 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-49f17824-f424-470f-b899-a6a100f47ba7 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:33.049152 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-49f17824-f424-470f-b899-a6a100f47ba7 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:33.411631 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-9ae56261-15b9-4604-bb25-64ecd94b4cbb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:33.428619 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9ae56261-15b9-4604-bb25-64ecd94b4cbb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1516 microversion: 2.1 time: 0.689685 Jan 15 02:41:33.429290 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 121/223] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:32 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1516 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:33.452993 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-0cfcf489-01d9-41a9-929b-c2ce7eb7c4d0 req-6b1a623d-89cd-417f-9973-990cbe93f463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9afd72bb-19e4-4afc-a01b-8c289d6a572b", "name": "network-vif-plugged", "status": "completed", "tag": "5ee1a130-1756-4325-b512-c82fc07e9cbf"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:33.461393 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:41:33.461393 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:41:33.473252 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-0cfcf489-01d9-41a9-929b-c2ce7eb7c4d0 req-6b1a623d-89cd-417f-9973-990cbe93f463 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:33.474022 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-0cfcf489-01d9-41a9-929b-c2ce7eb7c4d0 req-6b1a623d-89cd-417f-9973-990cbe93f463 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:33.494748 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-0cfcf489-01d9-41a9-929b-c2ce7eb7c4d0 req-6b1a623d-89cd-417f-9973-990cbe93f463 service nova] Creating event network-vif-plugged:5ee1a130-1756-4325-b512-c82fc07e9cbf for instance 9afd72bb-19e4-4afc-a01b-8c289d6a572b on hv-cinder-76330 Jan 15 02:41:33.500949 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-0cfcf489-01d9-41a9-929b-c2ce7eb7c4d0 req-6b1a623d-89cd-417f-9973-990cbe93f463 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070275 Jan 15 02:41:33.502045 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 122/224] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:41:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:41:33.514037 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-303accb4-36a1-441c-b206-ab5b1afdae0a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:33.515665 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-303accb4-36a1-441c-b206-ab5b1afdae0a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:33.526439 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-303accb4-36a1-441c-b206-ab5b1afdae0a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:33.527379 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-303accb4-36a1-441c-b206-ab5b1afdae0a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:33.528471 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-303accb4-36a1-441c-b206-ab5b1afdae0a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:33.529231 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-303accb4-36a1-441c-b206-ab5b1afdae0a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:33.728798 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-303accb4-36a1-441c-b206-ab5b1afdae0a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 200 len: 14 microversion: 2.1 time: 0.224210 Jan 15 02:41:33.729801 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 123/225] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:41:33 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 14 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:41:33.762927 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-5fdc6f26-fe83-40e8-8bb5-9581e05ee656 req-a83527f2-8fd0-40b6-ae61-983ee11efcc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e38a45f-624e-4ca4-9f81-3d92ce319b50", "tag": "cb869005-2805-494c-8e3f-55bd108b2f03"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:33.770600 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:41:33.770600 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:41:33.798415 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-5fdc6f26-fe83-40e8-8bb5-9581e05ee656 req-a83527f2-8fd0-40b6-ae61-983ee11efcc9 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:33.800335 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-5fdc6f26-fe83-40e8-8bb5-9581e05ee656 req-a83527f2-8fd0-40b6-ae61-983ee11efcc9 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:33.843523 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-5fdc6f26-fe83-40e8-8bb5-9581e05ee656 req-a83527f2-8fd0-40b6-ae61-983ee11efcc9 service nova] Creating event network-changed:cb869005-2805-494c-8e3f-55bd108b2f03 for instance 6e38a45f-624e-4ca4-9f81-3d92ce319b50 on hv-cinder-76330 Jan 15 02:41:33.859577 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-5fdc6f26-fe83-40e8-8bb5-9581e05ee656 req-a83527f2-8fd0-40b6-ae61-983ee11efcc9 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127827 Jan 15 02:41:33.862836 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 124/226] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:41:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:41:33.887469 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1f665948-caac-4aed-b3a9-35a61b5c78db tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:33.889657 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1f665948-caac-4aed-b3a9-35a61b5c78db tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] [instance: 9afd72bb-19e4-4afc-a01b-8c289d6a572b] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:33.909122 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1f665948-caac-4aed-b3a9-35a61b5c78db tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:33.912026 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1f665948-caac-4aed-b3a9-35a61b5c78db tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:33.918844 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1f665948-caac-4aed-b3a9-35a61b5c78db tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:33.919983 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1f665948-caac-4aed-b3a9-35a61b5c78db tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:34.709667 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1f665948-caac-4aed-b3a9-35a61b5c78db tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b609b787be042b5bd55b9019a351a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b2895583774e1fb625c9bf7dac65b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:34.727085 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1f665948-caac-4aed-b3a9-35a61b5c78db tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] 10.222.0.37 "GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b" status: 200 len: 1314 microversion: 2.1 time: 0.862607 Jan 15 02:41:34.731782 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 125/227] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:33 2021] GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b => generated 1314 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:34.776892 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d12c4b6f-5a91-4808-aca9-a0329c30c466 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:34.777888 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d12c4b6f-5a91-4808-aca9-a0329c30c466 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:34.796951 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d12c4b6f-5a91-4808-aca9-a0329c30c466 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:34.802723 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d12c4b6f-5a91-4808-aca9-a0329c30c466 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:34.804245 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d12c4b6f-5a91-4808-aca9-a0329c30c466 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:34.804943 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d12c4b6f-5a91-4808-aca9-a0329c30c466 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:36.320281 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-49f17824-f424-470f-b899-a6a100f47ba7 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:36.343674 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-49f17824-f424-470f-b899-a6a100f47ba7 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2" status: 200 len: 1504 microversion: 2.1 time: 3.323755 Jan 15 02:41:36.345943 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 103/228] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:33 2021] GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2 => generated 1504 bytes in 3329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:36.392178 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-da10a256-b360-4108-912c-c08903af57d4 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:36.396467 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-da10a256-b360-4108-912c-c08903af57d4 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:36.418561 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-da10a256-b360-4108-912c-c08903af57d4 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:36.420041 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-da10a256-b360-4108-912c-c08903af57d4 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:36.421984 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-da10a256-b360-4108-912c-c08903af57d4 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:36.423267 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-da10a256-b360-4108-912c-c08903af57d4 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:37.081774 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d12c4b6f-5a91-4808-aca9-a0329c30c466 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:37.154502 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d12c4b6f-5a91-4808-aca9-a0329c30c466 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:37.204283 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d12c4b6f-5a91-4808-aca9-a0329c30c466 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:37.208593 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d12c4b6f-5a91-4808-aca9-a0329c30c466 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1741 microversion: 2.20 time: 2.452710 Jan 15 02:41:37.221580 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 126/229] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:41:34 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1741 bytes in 2468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:41:37.276230 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-8d1b9b60-0084-4fae-9286-cca718cbd26c req-8d72a0a7-9de8-4a94-a8c9-58ab39abf5d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ed9ee0-28da-4fab-a4fc-3c52751013f2", "name": "network-vif-unplugged", "status": "completed", "tag": "a88a90e6-0fd7-435e-b61b-ece1a8288f77"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:37.316943 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:41:37.316943 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:41:37.361296 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-8d1b9b60-0084-4fae-9286-cca718cbd26c req-8d72a0a7-9de8-4a94-a8c9-58ab39abf5d9 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:37.363068 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-8d1b9b60-0084-4fae-9286-cca718cbd26c req-8d72a0a7-9de8-4a94-a8c9-58ab39abf5d9 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:37.411189 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-8d1b9b60-0084-4fae-9286-cca718cbd26c req-8d72a0a7-9de8-4a94-a8c9-58ab39abf5d9 service nova] Creating event network-vif-unplugged:a88a90e6-0fd7-435e-b61b-ece1a8288f77 for instance 10ed9ee0-28da-4fab-a4fc-3c52751013f2 on hv-cinder-76330 Jan 15 02:41:37.422908 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-8d1b9b60-0084-4fae-9286-cca718cbd26c req-8d72a0a7-9de8-4a94-a8c9-58ab39abf5d9 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.197909 Jan 15 02:41:37.425244 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 127/230] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:41:37 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:41:37.464127 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e1db7374-45b8-4264-83c8-3d5aeb78dea7 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:37.468313 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e1db7374-45b8-4264-83c8-3d5aeb78dea7 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] [instance: 9afd72bb-19e4-4afc-a01b-8c289d6a572b] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:37.514484 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e1db7374-45b8-4264-83c8-3d5aeb78dea7 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:37.516654 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e1db7374-45b8-4264-83c8-3d5aeb78dea7 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:37.520828 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e1db7374-45b8-4264-83c8-3d5aeb78dea7 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:37.522641 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e1db7374-45b8-4264-83c8-3d5aeb78dea7 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:38.348149 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e1db7374-45b8-4264-83c8-3d5aeb78dea7 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b609b787be042b5bd55b9019a351a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b2895583774e1fb625c9bf7dac65b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:38.382007 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e1db7374-45b8-4264-83c8-3d5aeb78dea7 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] 10.222.0.37 "GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b" status: 200 len: 1314 microversion: 2.1 time: 0.944739 Jan 15 02:41:38.382808 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 128/231] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:37 2021] GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b => generated 1314 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:38.454658 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ee376c97-8ae3-4080-8e8d-08d88968bb91 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:38.480847 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ee376c97-8ae3-4080-8e8d-08d88968bb91 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:38.517791 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ee376c97-8ae3-4080-8e8d-08d88968bb91 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:38.518788 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ee376c97-8ae3-4080-8e8d-08d88968bb91 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:38.527529 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ee376c97-8ae3-4080-8e8d-08d88968bb91 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:38.528693 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ee376c97-8ae3-4080-8e8d-08d88968bb91 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:39.153119 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-ee376c97-8ae3-4080-8e8d-08d88968bb91 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:39.153119 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ee376c97-8ae3-4080-8e8d-08d88968bb91 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1516 microversion: 2.1 time: 0.726835 Jan 15 02:41:39.153119 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 129/232] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:38 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1516 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:39.159963 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-00ab8ff2-bbaf-45c5-97d9-b11496101f84 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:39.159963 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-00ab8ff2-bbaf-45c5-97d9-b11496101f84 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 10ed9ee0-28da-4fab-a4fc-3c52751013f2] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:39.170114 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-00ab8ff2-bbaf-45c5-97d9-b11496101f84 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:39.170633 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-00ab8ff2-bbaf-45c5-97d9-b11496101f84 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:39.171556 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-00ab8ff2-bbaf-45c5-97d9-b11496101f84 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:39.172394 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-00ab8ff2-bbaf-45c5-97d9-b11496101f84 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:39.475597 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-da10a256-b360-4108-912c-c08903af57d4 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 200 len: 14 microversion: 2.1 time: 3.127329 Jan 15 02:41:39.477055 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 104/233] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:41:36 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 14 bytes in 3130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:41:39.504741 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-2b4f938f-9907-47fa-8340-407920b562b9 req-24814680-e231-4437-93ae-ae4f08ae1f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ed9ee0-28da-4fab-a4fc-3c52751013f2", "name": "network-vif-deleted", "tag": "a88a90e6-0fd7-435e-b61b-ece1a8288f77"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:39.515275 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:41:39.515275 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:41:39.531815 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-2b4f938f-9907-47fa-8340-407920b562b9 req-24814680-e231-4437-93ae-ae4f08ae1f5e service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:39.533142 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-2b4f938f-9907-47fa-8340-407920b562b9 req-24814680-e231-4437-93ae-ae4f08ae1f5e service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:39.542447 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-00ab8ff2-bbaf-45c5-97d9-b11496101f84 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:39.558538 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-2b4f938f-9907-47fa-8340-407920b562b9 req-24814680-e231-4437-93ae-ae4f08ae1f5e service nova] Creating event network-vif-deleted:a88a90e6-0fd7-435e-b61b-ece1a8288f77 for instance 10ed9ee0-28da-4fab-a4fc-3c52751013f2 on hv-cinder-76330 Jan 15 02:41:39.573780 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-2b4f938f-9907-47fa-8340-407920b562b9 req-24814680-e231-4437-93ae-ae4f08ae1f5e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093503 Jan 15 02:41:39.574510 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 105/234] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:41:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:41:39.588684 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3a6d6997-50ed-4e3a-8e38-e38e9b71f884 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:39.601135 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3a6d6997-50ed-4e3a-8e38-e38e9b71f884 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:39.627670 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-00ab8ff2-bbaf-45c5-97d9-b11496101f84 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2" status: 200 len: 1462 microversion: 2.1 time: 0.484108 Jan 15 02:41:39.649832 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a6d6997-50ed-4e3a-8e38-e38e9b71f884 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:39.649832 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a6d6997-50ed-4e3a-8e38-e38e9b71f884 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:39.650485 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a6d6997-50ed-4e3a-8e38-e38e9b71f884 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:39.652477 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a6d6997-50ed-4e3a-8e38-e38e9b71f884 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:39.662389 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 130/235] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:39 2021] GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2 => generated 1462 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:39.714699 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c24b39c3-9c0f-4bb6-8ec7-31207e8c4cec tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9c66074-4f6c-43f1-b924-f2cd6d31a27d"}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:39.722638 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c24b39c3-9c0f-4bb6-8ec7-31207e8c4cec tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:39.760432 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c24b39c3-9c0f-4bb6-8ec7-31207e8c4cec tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:39.766336 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c24b39c3-9c0f-4bb6-8ec7-31207e8c4cec tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:39.768643 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c24b39c3-9c0f-4bb6-8ec7-31207e8c4cec tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:39.774757 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c24b39c3-9c0f-4bb6-8ec7-31207e8c4cec tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:41.188915 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3a6d6997-50ed-4e3a-8e38-e38e9b71f884 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:41.251759 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3a6d6997-50ed-4e3a-8e38-e38e9b71f884 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:41.297560 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3a6d6997-50ed-4e3a-8e38-e38e9b71f884 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:41.299094 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3a6d6997-50ed-4e3a-8e38-e38e9b71f884 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1741 microversion: 2.20 time: 1.723362 Jan 15 02:41:41.300144 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 106/236] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:41:39 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1741 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:41:41.328867 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e5e5dddb-4294-49e4-bd35-90b44939712e tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:41.334120 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e5e5dddb-4294-49e4-bd35-90b44939712e tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] [instance: 9afd72bb-19e4-4afc-a01b-8c289d6a572b] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:41.354780 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e5e5dddb-4294-49e4-bd35-90b44939712e tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:41.357596 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e5e5dddb-4294-49e4-bd35-90b44939712e tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:41.362732 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e5e5dddb-4294-49e4-bd35-90b44939712e tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:41.363371 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e5e5dddb-4294-49e4-bd35-90b44939712e tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:41.572072 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c24b39c3-9c0f-4bb6-8ec7-31207e8c4cec tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "POST /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.907166 Jan 15 02:41:41.576727 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 131/237] 10.222.0.37 () {60 vars in 1313 bytes} [Fri Jan 15 02:41:39 2021] POST /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6/os-volume_attachments => generated 194 bytes in 1913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:41:41.599765 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-53520138-5489-4e4c-b082-7cbcea219b66 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:41.610129 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-53520138-5489-4e4c-b082-7cbcea219b66 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:41.641419 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-53520138-5489-4e4c-b082-7cbcea219b66 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:41.643557 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-53520138-5489-4e4c-b082-7cbcea219b66 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:41.645332 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-53520138-5489-4e4c-b082-7cbcea219b66 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:41.646114 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-53520138-5489-4e4c-b082-7cbcea219b66 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:41.902474 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-53520138-5489-4e4c-b082-7cbcea219b66 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 200 len: 10009 microversion: 2.1 time: 0.319648 Jan 15 02:41:41.904977 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 132/238] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:41:41 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 10009 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:41:41.947349 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-91c6fe1f-767f-4f26-8d8f-3788597e4b71 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:41.948735 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-91c6fe1f-767f-4f26-8d8f-3788597e4b71 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 10ed9ee0-28da-4fab-a4fc-3c52751013f2] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:41.974379 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-91c6fe1f-767f-4f26-8d8f-3788597e4b71 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:41.979688 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-91c6fe1f-767f-4f26-8d8f-3788597e4b71 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:41.981120 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-91c6fe1f-767f-4f26-8d8f-3788597e4b71 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:41.982199 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-91c6fe1f-767f-4f26-8d8f-3788597e4b71 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:42.148069 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-91c6fe1f-767f-4f26-8d8f-3788597e4b71 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] HTTP exception thrown: Instance 10ed9ee0-28da-4fab-a4fc-3c52751013f2 could not be found. Jan 15 02:41:42.150369 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-91c6fe1f-767f-4f26-8d8f-3788597e4b71 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Returning 404 to user: Instance 10ed9ee0-28da-4fab-a4fc-3c52751013f2 could not be found. {{(pid=94111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:41:42.154634 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-91c6fe1f-767f-4f26-8d8f-3788597e4b71 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2" status: 404 len: 111 microversion: 2.1 time: 0.246032 Jan 15 02:41:42.157454 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 133/239] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:41 2021] GET /compute/v2.1/servers/10ed9ee0-28da-4fab-a4fc-3c52751013f2 => generated 111 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:41:42.340090 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-0de8aca0-f224-4ef2-a68f-bae5b280a3d8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:42.340929 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-0de8aca0-f224-4ef2-a68f-bae5b280a3d8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:42.381100 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0de8aca0-f224-4ef2-a68f-bae5b280a3d8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:42.381622 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0de8aca0-f224-4ef2-a68f-bae5b280a3d8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:42.382959 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0de8aca0-f224-4ef2-a68f-bae5b280a3d8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:42.384028 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0de8aca0-f224-4ef2-a68f-bae5b280a3d8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:42.846062 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e5e5dddb-4294-49e4-bd35-90b44939712e tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b609b787be042b5bd55b9019a351a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b2895583774e1fb625c9bf7dac65b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:42.887263 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e5e5dddb-4294-49e4-bd35-90b44939712e tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] 10.222.0.37 "GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b" status: 200 len: 1464 microversion: 2.1 time: 1.578634 Jan 15 02:41:42.889189 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 107/240] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:41 2021] GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b => generated 1464 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:42.948996 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c88b9138-8966-4e8e-9f26-8d3d3d3bf253 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:42.951173 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c88b9138-8966-4e8e-9f26-8d3d3d3bf253 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:42.980813 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c88b9138-8966-4e8e-9f26-8d3d3d3bf253 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:42.982166 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c88b9138-8966-4e8e-9f26-8d3d3d3bf253 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:42.983900 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c88b9138-8966-4e8e-9f26-8d3d3d3bf253 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:42.984972 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c88b9138-8966-4e8e-9f26-8d3d3d3bf253 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:43.055637 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0de8aca0-f224-4ef2-a68f-bae5b280a3d8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:43.123784 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0de8aca0-f224-4ef2-a68f-bae5b280a3d8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:43.153512 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0de8aca0-f224-4ef2-a68f-bae5b280a3d8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:43.159408 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-0de8aca0-f224-4ef2-a68f-bae5b280a3d8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1741 microversion: 2.20 time: 0.842602 Jan 15 02:41:43.169171 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 134/241] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:41:42 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1741 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:41:43.218332 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a3baf461-9211-474b-a1da-fbc9309f94fd tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1272063889", "imageRef": "1807a1cb-835d-4a56-8751-82ffa40b12c9", "flavorRef": "452", "networks": [{"uuid": "02affeb9-1ed6-4661-a47f-99c47b7eaf89"}]}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:43.273488 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c88b9138-8966-4e8e-9f26-8d3d3d3bf253 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 200 len: 17602 microversion: 2.1 time: 0.359774 Jan 15 02:41:43.274944 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 108/242] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:41:42 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 17602 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:41:43.321704 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9f391ce6-94a2-4b78-98a6-0c7ea425ff7d tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:43.334593 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9f391ce6-94a2-4b78-98a6-0c7ea425ff7d tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] [instance: 9afd72bb-19e4-4afc-a01b-8c289d6a572b] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:43.374484 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9f391ce6-94a2-4b78-98a6-0c7ea425ff7d tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:43.375755 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9f391ce6-94a2-4b78-98a6-0c7ea425ff7d tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:43.379729 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9f391ce6-94a2-4b78-98a6-0c7ea425ff7d tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:43.381102 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9f391ce6-94a2-4b78-98a6-0c7ea425ff7d tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:43.391424 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-a3baf461-9211-474b-a1da-fbc9309f94fd tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] validate_networks() for [('02affeb9-1ed6-4661-a47f-99c47b7eaf89', None, None, None)] {{(pid=94111) validate_networks /opt/stack/nova/nova/network/neutron.py:2340}} Jan 15 02:41:43.511028 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9f391ce6-94a2-4b78-98a6-0c7ea425ff7d tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] [instance: 9afd72bb-19e4-4afc-a01b-8c289d6a572b] Going to try to terminate instance {{(pid=94112) delete /opt/stack/nova/nova/compute/api.py:2535}} Jan 15 02:41:43.720603 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9f391ce6-94a2-4b78-98a6-0c7ea425ff7d tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] 10.222.0.37 "DELETE /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b" status: 204 len: 0 microversion: 2.1 time: 0.443580 Jan 15 02:41:43.721282 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 109/243] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:41:43 2021] DELETE /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 02:41:43.761553 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f1f17751-74b1-4a85-93c8-32c99ac69364 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:43.762428 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f1f17751-74b1-4a85-93c8-32c99ac69364 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] [instance: 9afd72bb-19e4-4afc-a01b-8c289d6a572b] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:43.792807 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f1f17751-74b1-4a85-93c8-32c99ac69364 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:43.793782 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f1f17751-74b1-4a85-93c8-32c99ac69364 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:43.796649 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f1f17751-74b1-4a85-93c8-32c99ac69364 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:43.796649 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f1f17751-74b1-4a85-93c8-32c99ac69364 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:44.464016 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f1f17751-74b1-4a85-93c8-32c99ac69364 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b609b787be042b5bd55b9019a351a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b2895583774e1fb625c9bf7dac65b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:44.520757 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f1f17751-74b1-4a85-93c8-32c99ac69364 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] 10.222.0.37 "GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b" status: 200 len: 1470 microversion: 2.1 time: 0.791715 Jan 15 02:41:44.537066 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 110/244] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:43 2021] GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b => generated 1470 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:44.564372 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-712038de-12e1-4278-b73f-4edadc312895 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:44.565118 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-712038de-12e1-4278-b73f-4edadc312895 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:44.590233 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-712038de-12e1-4278-b73f-4edadc312895 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:44.591167 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-712038de-12e1-4278-b73f-4edadc312895 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:44.592895 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-712038de-12e1-4278-b73f-4edadc312895 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:44.593440 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-712038de-12e1-4278-b73f-4edadc312895 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:44.606118 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-a3baf461-9211-474b-a1da-fbc9309f94fd tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Flavor limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 02:41:44.606603 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-a3baf461-9211-474b-a1da-fbc9309f94fd tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Image limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Jan 15 02:41:44.607150 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-a3baf461-9211-474b-a1da-fbc9309f94fd tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Flavor pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 02:41:44.607611 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-a3baf461-9211-474b-a1da-fbc9309f94fd tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Image pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Jan 15 02:41:44.608076 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-a3baf461-9211-474b-a1da-fbc9309f94fd tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Jan 15 02:41:44.640476 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a3baf461-9211-474b-a1da-fbc9309f94fd tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:44.641078 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a3baf461-9211-474b-a1da-fbc9309f94fd tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:44.646252 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a3baf461-9211-474b-a1da-fbc9309f94fd tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:44.646775 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a3baf461-9211-474b-a1da-fbc9309f94fd tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:44.701593 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-a3baf461-9211-474b-a1da-fbc9309f94fd tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Getting quotas for project 0afa87010f244e1b998f04858f116ee6. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:41:44.706768 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-a3baf461-9211-474b-a1da-fbc9309f94fd tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Getting quotas for user 394c8449171243ed9871a947b62c02d3 and project 0afa87010f244e1b998f04858f116ee6. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:41:44.721221 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a3baf461-9211-474b-a1da-fbc9309f94fd tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Going to run 1 instances... {{(pid=94111) _provision_instances /opt/stack/nova/nova/compute/api.py:1263}} Jan 15 02:41:44.723569 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a3baf461-9211-474b-a1da-fbc9309f94fd tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 7836b504-3cbd-48ca-8fa3-02930a6f27e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1807a1cb-835d-4a56-8751-82ffa40b12c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1661}} Jan 15 02:41:44.800932 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a3baf461-9211-474b-a1da-fbc9309f94fd tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.604809 Jan 15 02:41:44.802167 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 135/245] 10.222.0.37 () {60 vars in 1137 bytes} [Fri Jan 15 02:41:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 1611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 02:41:44.818326 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f1a57afc-0b72-4c43-86ee-a2f63db0ca3c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:44.819647 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f1a57afc-0b72-4c43-86ee-a2f63db0ca3c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:44.830642 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f1a57afc-0b72-4c43-86ee-a2f63db0ca3c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:44.831340 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f1a57afc-0b72-4c43-86ee-a2f63db0ca3c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:44.832562 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f1a57afc-0b72-4c43-86ee-a2f63db0ca3c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:44.833246 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f1a57afc-0b72-4c43-86ee-a2f63db0ca3c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:45.053272 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f1a57afc-0b72-4c43-86ee-a2f63db0ca3c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 200 len: 19342 microversion: 2.1 time: 0.247700 Jan 15 02:41:45.054900 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 136/246] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:41:44 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 19342 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:41:45.082039 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-14943594-1a88-4572-936c-a3bc5343e056 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:45.083633 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-14943594-1a88-4572-936c-a3bc5343e056 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 7836b504-3cbd-48ca-8fa3-02930a6f27e1] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:45.244374 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-712038de-12e1-4278-b73f-4edadc312895 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:45.271031 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-14943594-1a88-4572-936c-a3bc5343e056 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:45.283578 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-14943594-1a88-4572-936c-a3bc5343e056 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1" status: 200 len: 1214 microversion: 2.1 time: 0.226508 Jan 15 02:41:45.293069 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 137/247] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:45 2021] GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1 => generated 1214 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:45.342312 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-712038de-12e1-4278-b73f-4edadc312895 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:45.365437 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-712038de-12e1-4278-b73f-4edadc312895 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:45.367594 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-712038de-12e1-4278-b73f-4edadc312895 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1741 microversion: 2.20 time: 0.839095 Jan 15 02:41:45.376025 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 111/248] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:41:44 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1741 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:41:45.567886 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d37b7067-b953-40b2-ae75-9ba3c8a32fd9 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:45.568854 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d37b7067-b953-40b2-ae75-9ba3c8a32fd9 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] [instance: 9afd72bb-19e4-4afc-a01b-8c289d6a572b] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:45.582503 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d37b7067-b953-40b2-ae75-9ba3c8a32fd9 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:45.583056 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d37b7067-b953-40b2-ae75-9ba3c8a32fd9 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:45.584377 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d37b7067-b953-40b2-ae75-9ba3c8a32fd9 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:45.584876 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d37b7067-b953-40b2-ae75-9ba3c8a32fd9 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:46.076502 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b6ade3da-6665-4677-8dd2-e3432538eeb2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:46.116121 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b6ade3da-6665-4677-8dd2-e3432538eeb2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:46.158356 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b6ade3da-6665-4677-8dd2-e3432538eeb2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:46.170042 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b6ade3da-6665-4677-8dd2-e3432538eeb2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:46.176583 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b6ade3da-6665-4677-8dd2-e3432538eeb2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:46.177588 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b6ade3da-6665-4677-8dd2-e3432538eeb2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:46.368410 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d37b7067-b953-40b2-ae75-9ba3c8a32fd9 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b609b787be042b5bd55b9019a351a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b2895583774e1fb625c9bf7dac65b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:46.413021 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d37b7067-b953-40b2-ae75-9ba3c8a32fd9 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] 10.222.0.37 "GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b" status: 200 len: 1470 microversion: 2.1 time: 0.849537 Jan 15 02:41:46.414257 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 138/249] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:45 2021] GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b => generated 1470 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:46.427241 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-644242c4-9237-46d6-9016-35d6503894e5 req-b723a1df-95a1-4c81-bb36-a8069dc8a453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9afd72bb-19e4-4afc-a01b-8c289d6a572b", "name": "network-vif-unplugged", "status": "completed", "tag": "5ee1a130-1756-4325-b512-c82fc07e9cbf"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:46.437214 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:41:46.437214 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:41:46.471299 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-644242c4-9237-46d6-9016-35d6503894e5 req-b723a1df-95a1-4c81-bb36-a8069dc8a453 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:46.472286 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-644242c4-9237-46d6-9016-35d6503894e5 req-b723a1df-95a1-4c81-bb36-a8069dc8a453 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:46.505161 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-644242c4-9237-46d6-9016-35d6503894e5 req-b723a1df-95a1-4c81-bb36-a8069dc8a453 service nova] Creating event network-vif-unplugged:5ee1a130-1756-4325-b512-c82fc07e9cbf for instance 9afd72bb-19e4-4afc-a01b-8c289d6a572b on hv-cinder-76330 Jan 15 02:41:46.518764 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-644242c4-9237-46d6-9016-35d6503894e5 req-b723a1df-95a1-4c81-bb36-a8069dc8a453 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101758 Jan 15 02:41:46.521573 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 139/250] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:41:46 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:41:46.554351 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-50b25f4a-192d-4c2b-91fd-00824bfcc4e1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:46.555593 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-50b25f4a-192d-4c2b-91fd-00824bfcc4e1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 7836b504-3cbd-48ca-8fa3-02930a6f27e1] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:46.579860 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-50b25f4a-192d-4c2b-91fd-00824bfcc4e1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:46.580387 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-50b25f4a-192d-4c2b-91fd-00824bfcc4e1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:46.581300 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-50b25f4a-192d-4c2b-91fd-00824bfcc4e1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:46.581807 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-50b25f4a-192d-4c2b-91fd-00824bfcc4e1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:46.668596 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b6ade3da-6665-4677-8dd2-e3432538eeb2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 200 len: 22113 microversion: 2.1 time: 0.603292 Jan 15 02:41:46.670174 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 112/251] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:41:46 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 22113 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:41:46.695132 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-73c90cd5-c7f5-4c17-b8bf-5167d79e039c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:46.699196 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-73c90cd5-c7f5-4c17-b8bf-5167d79e039c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:46.719343 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-73c90cd5-c7f5-4c17-b8bf-5167d79e039c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:46.720461 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-73c90cd5-c7f5-4c17-b8bf-5167d79e039c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:46.722149 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-73c90cd5-c7f5-4c17-b8bf-5167d79e039c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:46.731213 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-73c90cd5-c7f5-4c17-b8bf-5167d79e039c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:46.997063 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-50b25f4a-192d-4c2b-91fd-00824bfcc4e1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:47.041444 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-50b25f4a-192d-4c2b-91fd-00824bfcc4e1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1" status: 200 len: 1266 microversion: 2.1 time: 0.516975 Jan 15 02:41:47.045865 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 140/252] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:46 2021] GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1 => generated 1266 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:47.447822 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4c336e9b-b81d-45d4-a2fc-9706081838a1 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:47.448764 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4c336e9b-b81d-45d4-a2fc-9706081838a1 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] [instance: 9afd72bb-19e4-4afc-a01b-8c289d6a572b] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:47.477930 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4c336e9b-b81d-45d4-a2fc-9706081838a1 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:47.479354 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4c336e9b-b81d-45d4-a2fc-9706081838a1 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:47.480530 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4c336e9b-b81d-45d4-a2fc-9706081838a1 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:47.481251 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4c336e9b-b81d-45d4-a2fc-9706081838a1 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:47.720225 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4c336e9b-b81d-45d4-a2fc-9706081838a1 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b609b787be042b5bd55b9019a351a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b2895583774e1fb625c9bf7dac65b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:47.732730 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4c336e9b-b81d-45d4-a2fc-9706081838a1 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] 10.222.0.37 "GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b" status: 200 len: 1428 microversion: 2.1 time: 0.303854 Jan 15 02:41:47.733516 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 141/253] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:47 2021] GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b => generated 1428 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:41:47.746431 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4eacf1f1-8872-4d5c-8167-4c8208531455 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:47.747811 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4eacf1f1-8872-4d5c-8167-4c8208531455 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:47.757341 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4eacf1f1-8872-4d5c-8167-4c8208531455 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:47.758353 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4eacf1f1-8872-4d5c-8167-4c8208531455 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:47.759198 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4eacf1f1-8872-4d5c-8167-4c8208531455 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:47.760088 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4eacf1f1-8872-4d5c-8167-4c8208531455 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:47.954451 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-73c90cd5-c7f5-4c17-b8bf-5167d79e039c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:47.989429 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-73c90cd5-c7f5-4c17-b8bf-5167d79e039c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:48.013433 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-73c90cd5-c7f5-4c17-b8bf-5167d79e039c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:48.015770 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-73c90cd5-c7f5-4c17-b8bf-5167d79e039c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1741 microversion: 2.20 time: 1.344120 Jan 15 02:41:48.016370 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 113/254] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:41:46 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1741 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:41:48.047437 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-6c117ef1-d297-4060-a28a-116d405f2a19 req-22e087c2-6040-4482-a331-8972ff0fa744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9afd72bb-19e4-4afc-a01b-8c289d6a572b", "name": "network-vif-deleted", "tag": "5ee1a130-1756-4325-b512-c82fc07e9cbf"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:48.061305 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:41:48.061305 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:41:48.090122 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-6c117ef1-d297-4060-a28a-116d405f2a19 req-22e087c2-6040-4482-a331-8972ff0fa744 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:48.091004 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-6c117ef1-d297-4060-a28a-116d405f2a19 req-22e087c2-6040-4482-a331-8972ff0fa744 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:48.120484 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-6c117ef1-d297-4060-a28a-116d405f2a19 req-22e087c2-6040-4482-a331-8972ff0fa744 service nova] Creating event network-vif-deleted:5ee1a130-1756-4325-b512-c82fc07e9cbf for instance 9afd72bb-19e4-4afc-a01b-8c289d6a572b on hv-cinder-76330 Jan 15 02:41:48.139514 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-6c117ef1-d297-4060-a28a-116d405f2a19 req-22e087c2-6040-4482-a331-8972ff0fa744 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114496 Jan 15 02:41:48.140258 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 114/255] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:41:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:41:48.154877 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-bba40062-db20-4d03-bb65-facac5e92ed1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:48.155657 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-bba40062-db20-4d03-bb65-facac5e92ed1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 7836b504-3cbd-48ca-8fa3-02930a6f27e1] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:48.165300 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bba40062-db20-4d03-bb65-facac5e92ed1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:48.165915 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bba40062-db20-4d03-bb65-facac5e92ed1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:48.166687 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bba40062-db20-4d03-bb65-facac5e92ed1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:48.167180 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bba40062-db20-4d03-bb65-facac5e92ed1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:48.353061 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-bba40062-db20-4d03-bb65-facac5e92ed1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:48.363785 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-bba40062-db20-4d03-bb65-facac5e92ed1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1" status: 200 len: 1272 microversion: 2.1 time: 0.220155 Jan 15 02:41:48.364759 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 115/256] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:48 2021] GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1 => generated 1272 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:48.779716 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-83085f06-6fff-4fd1-ac0a-376288dc6632 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:48.782035 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-83085f06-6fff-4fd1-ac0a-376288dc6632 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] [instance: 9afd72bb-19e4-4afc-a01b-8c289d6a572b] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:48.798601 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-83085f06-6fff-4fd1-ac0a-376288dc6632 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:48.799549 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-83085f06-6fff-4fd1-ac0a-376288dc6632 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:48.801201 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-83085f06-6fff-4fd1-ac0a-376288dc6632 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:48.802116 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-83085f06-6fff-4fd1-ac0a-376288dc6632 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:49.033547 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-83085f06-6fff-4fd1-ac0a-376288dc6632 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b609b787be042b5bd55b9019a351a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b2895583774e1fb625c9bf7dac65b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:49.064616 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-83085f06-6fff-4fd1-ac0a-376288dc6632 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] 10.222.0.37 "GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b" status: 200 len: 1428 microversion: 2.1 time: 0.315578 Jan 15 02:41:49.078153 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 116/257] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:48 2021] GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b => generated 1428 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:41:49.097349 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-266cfece-aaca-421d-8092-a228b10be45b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:49.098212 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-266cfece-aaca-421d-8092-a228b10be45b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:49.108508 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-266cfece-aaca-421d-8092-a228b10be45b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:49.109058 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-266cfece-aaca-421d-8092-a228b10be45b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:49.109965 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-266cfece-aaca-421d-8092-a228b10be45b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:49.110528 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-266cfece-aaca-421d-8092-a228b10be45b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:49.483266 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-266cfece-aaca-421d-8092-a228b10be45b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:49.516335 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-266cfece-aaca-421d-8092-a228b10be45b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:49.533235 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-266cfece-aaca-421d-8092-a228b10be45b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:49.535702 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-266cfece-aaca-421d-8092-a228b10be45b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1741 microversion: 2.20 time: 0.465901 Jan 15 02:41:49.553590 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 117/258] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:41:49 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1741 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:41:49.558105 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9f7fe8b2-fba5-4e11-8e80-a8b9a7c766b1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:49.559363 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9f7fe8b2-fba5-4e11-8e80-a8b9a7c766b1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 7836b504-3cbd-48ca-8fa3-02930a6f27e1] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:49.576147 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9f7fe8b2-fba5-4e11-8e80-a8b9a7c766b1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:49.577096 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9f7fe8b2-fba5-4e11-8e80-a8b9a7c766b1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:49.578702 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9f7fe8b2-fba5-4e11-8e80-a8b9a7c766b1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:49.579612 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9f7fe8b2-fba5-4e11-8e80-a8b9a7c766b1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:49.777156 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-9f7fe8b2-fba5-4e11-8e80-a8b9a7c766b1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:49.787129 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9f7fe8b2-fba5-4e11-8e80-a8b9a7c766b1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1" status: 200 len: 1272 microversion: 2.1 time: 0.248786 Jan 15 02:41:49.787705 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 118/259] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:49 2021] GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1 => generated 1272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:50.034616 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4eacf1f1-8872-4d5c-8167-4c8208531455 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 200 len: 25969 microversion: 2.1 time: 2.298768 Jan 15 02:41:50.042545 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 142/260] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:41:47 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 25969 bytes in 2303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:41:50.118528 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-70933a79-ee91-4f05-93cd-4379257182d7 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:50.119581 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-70933a79-ee91-4f05-93cd-4379257182d7 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] [instance: 9afd72bb-19e4-4afc-a01b-8c289d6a572b] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:50.150917 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-70933a79-ee91-4f05-93cd-4379257182d7 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:50.151432 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-70933a79-ee91-4f05-93cd-4379257182d7 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:50.152319 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-70933a79-ee91-4f05-93cd-4379257182d7 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:50.152812 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-70933a79-ee91-4f05-93cd-4379257182d7 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:50.325595 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-70933a79-ee91-4f05-93cd-4379257182d7 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b609b787be042b5bd55b9019a351a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b2895583774e1fb625c9bf7dac65b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:50.336735 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-70933a79-ee91-4f05-93cd-4379257182d7 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] 10.222.0.37 "GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b" status: 200 len: 1299 microversion: 2.1 time: 0.246536 Jan 15 02:41:50.340215 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 119/261] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:50 2021] GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b => generated 1299 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:50.601090 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-444925e2-c4da-4aa4-8831-622fed416bec tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:50.603242 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-444925e2-c4da-4aa4-8831-622fed416bec tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:50.625493 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-444925e2-c4da-4aa4-8831-622fed416bec tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:50.626773 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-444925e2-c4da-4aa4-8831-622fed416bec tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:50.628049 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-444925e2-c4da-4aa4-8831-622fed416bec tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:50.629754 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-444925e2-c4da-4aa4-8831-622fed416bec tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:50.814048 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-471836be-840e-421d-a79b-62cf33169003 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:50.815157 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-471836be-840e-421d-a79b-62cf33169003 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 7836b504-3cbd-48ca-8fa3-02930a6f27e1] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:50.857439 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-471836be-840e-421d-a79b-62cf33169003 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:50.861893 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-471836be-840e-421d-a79b-62cf33169003 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:50.863662 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-471836be-840e-421d-a79b-62cf33169003 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:50.868225 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-471836be-840e-421d-a79b-62cf33169003 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:51.357257 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-471836be-840e-421d-a79b-62cf33169003 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:51.371940 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-471836be-840e-421d-a79b-62cf33169003 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1" status: 200 len: 1272 microversion: 2.1 time: 0.568258 Jan 15 02:41:51.385116 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 120/262] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:50 2021] GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1 => generated 1272 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:51.397967 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-63ee5b62-58a5-4418-b6ee-35b85c9076a3 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:51.399124 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-63ee5b62-58a5-4418-b6ee-35b85c9076a3 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:51.426791 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-63ee5b62-58a5-4418-b6ee-35b85c9076a3 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:51.427295 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-63ee5b62-58a5-4418-b6ee-35b85c9076a3 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:51.428177 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-63ee5b62-58a5-4418-b6ee-35b85c9076a3 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:51.429044 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-63ee5b62-58a5-4418-b6ee-35b85c9076a3 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:51.784808 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-63ee5b62-58a5-4418-b6ee-35b85c9076a3 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 200 len: 27171 microversion: 2.1 time: 0.395749 Jan 15 02:41:51.795365 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 121/263] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:41:51 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 27171 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:41:51.874247 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-52e09304-ad7a-41e8-b704-a6e1fe328e39 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:51.878142 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-52e09304-ad7a-41e8-b704-a6e1fe328e39 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] [instance: 9afd72bb-19e4-4afc-a01b-8c289d6a572b] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:51.907338 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-444925e2-c4da-4aa4-8831-622fed416bec tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:51.909507 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-52e09304-ad7a-41e8-b704-a6e1fe328e39 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:51.910495 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-52e09304-ad7a-41e8-b704-a6e1fe328e39 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:51.912055 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-52e09304-ad7a-41e8-b704-a6e1fe328e39 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:51.917847 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-52e09304-ad7a-41e8-b704-a6e1fe328e39 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:52.017520 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-444925e2-c4da-4aa4-8831-622fed416bec tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:52.055401 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-444925e2-c4da-4aa4-8831-622fed416bec tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:52.060960 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-52e09304-ad7a-41e8-b704-a6e1fe328e39 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] HTTP exception thrown: Instance 9afd72bb-19e4-4afc-a01b-8c289d6a572b could not be found. Jan 15 02:41:52.061718 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-52e09304-ad7a-41e8-b704-a6e1fe328e39 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] Returning 404 to user: Instance 9afd72bb-19e4-4afc-a01b-8c289d6a572b could not be found. {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:41:52.062639 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-52e09304-ad7a-41e8-b704-a6e1fe328e39 tempest-VolumesNegativeTest-472194554 tempest-VolumesNegativeTest-472194554] 10.222.0.37 "GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b" status: 404 len: 111 microversion: 2.1 time: 0.265327 Jan 15 02:41:52.063270 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 122/264] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:51 2021] GET /compute/v2.1/servers/9afd72bb-19e4-4afc-a01b-8c289d6a572b => generated 111 bytes in 267 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:41:52.079925 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-444925e2-c4da-4aa4-8831-622fed416bec tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1741 microversion: 2.20 time: 1.511828 Jan 15 02:41:52.083935 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 143/265] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:41:50 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1741 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:41:52.358805 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-914897f6-b65f-423b-9c98-76014a385941 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:52.370923 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-914897f6-b65f-423b-9c98-76014a385941 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:52.410827 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d98b6971-6a5b-4e94-9e66-a0104552e4b6 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:52.413816 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d98b6971-6a5b-4e94-9e66-a0104552e4b6 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 7836b504-3cbd-48ca-8fa3-02930a6f27e1] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:52.422676 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-914897f6-b65f-423b-9c98-76014a385941 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:52.423520 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-914897f6-b65f-423b-9c98-76014a385941 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:52.424917 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-914897f6-b65f-423b-9c98-76014a385941 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:52.425773 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-914897f6-b65f-423b-9c98-76014a385941 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:52.436032 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d98b6971-6a5b-4e94-9e66-a0104552e4b6 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:52.437911 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d98b6971-6a5b-4e94-9e66-a0104552e4b6 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:52.440814 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d98b6971-6a5b-4e94-9e66-a0104552e4b6 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:52.445789 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d98b6971-6a5b-4e94-9e66-a0104552e4b6 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:52.756080 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.objects.instance [None req-914897f6-b65f-423b-9c98-76014a385941 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lazy-loading 'flavor' on Instance uuid e90ce195-f423-416c-859f-a6423d99efe6 {{(pid=94112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Jan 15 02:41:52.884224 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d98b6971-6a5b-4e94-9e66-a0104552e4b6 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:52.931735 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d98b6971-6a5b-4e94-9e66-a0104552e4b6 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1" status: 200 len: 1272 microversion: 2.1 time: 0.533327 Jan 15 02:41:52.937999 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 144/266] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:52 2021] GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1 => generated 1272 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:52.990268 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f8131f04-d59b-4150-bd2c-1a91148116ad tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:52.996419 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f8131f04-d59b-4150-bd2c-1a91148116ad tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:53.047203 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f8131f04-d59b-4150-bd2c-1a91148116ad tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:53.048085 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f8131f04-d59b-4150-bd2c-1a91148116ad tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:53.056650 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f8131f04-d59b-4150-bd2c-1a91148116ad tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:53.057951 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f8131f04-d59b-4150-bd2c-1a91148116ad tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:53.538532 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f8131f04-d59b-4150-bd2c-1a91148116ad tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 200 len: 27933 microversion: 2.1 time: 0.598454 Jan 15 02:41:53.540251 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 145/267] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:41:52 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 27933 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:41:53.588480 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-914897f6-b65f-423b-9c98-76014a385941 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "POST /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6/action" status: 200 len: 32 microversion: 2.1 time: 1.239907 Jan 15 02:41:53.595563 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 123/268] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:41:52 2021] POST /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6/action => generated 32 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:41:53.599008 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3adcb60f-6bfd-4a94-8475-8f7991b874bf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:53.600717 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3adcb60f-6bfd-4a94-8475-8f7991b874bf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:53.621778 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9a5e1b5e-e08f-4e06-88e4-a446b0f546d3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:53.641536 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3adcb60f-6bfd-4a94-8475-8f7991b874bf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:53.643338 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3adcb60f-6bfd-4a94-8475-8f7991b874bf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:53.645638 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9a5e1b5e-e08f-4e06-88e4-a446b0f546d3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:53.647792 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3adcb60f-6bfd-4a94-8475-8f7991b874bf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:53.650309 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3adcb60f-6bfd-4a94-8475-8f7991b874bf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:53.680944 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9a5e1b5e-e08f-4e06-88e4-a446b0f546d3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:53.689055 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9a5e1b5e-e08f-4e06-88e4-a446b0f546d3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:53.690135 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9a5e1b5e-e08f-4e06-88e4-a446b0f546d3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:53.690762 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9a5e1b5e-e08f-4e06-88e4-a446b0f546d3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:54.495079 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3adcb60f-6bfd-4a94-8475-8f7991b874bf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:54.554262 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3adcb60f-6bfd-4a94-8475-8f7991b874bf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:54.578046 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3adcb60f-6bfd-4a94-8475-8f7991b874bf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:54.580632 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3adcb60f-6bfd-4a94-8475-8f7991b874bf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1741 microversion: 2.20 time: 1.037349 Jan 15 02:41:54.581587 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 146/269] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:41:53 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1741 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:41:54.597894 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d83f60b2-2626-4764-b2a6-44ea231eb255 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:54.598797 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d83f60b2-2626-4764-b2a6-44ea231eb255 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 7836b504-3cbd-48ca-8fa3-02930a6f27e1] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:54.655974 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d83f60b2-2626-4764-b2a6-44ea231eb255 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:54.656482 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d83f60b2-2626-4764-b2a6-44ea231eb255 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:54.657388 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d83f60b2-2626-4764-b2a6-44ea231eb255 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:54.657884 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d83f60b2-2626-4764-b2a6-44ea231eb255 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:55.403423 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-9a5e1b5e-e08f-4e06-88e4-a446b0f546d3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:55.440730 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9a5e1b5e-e08f-4e06-88e4-a446b0f546d3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1568 microversion: 2.1 time: 1.837815 Jan 15 02:41:55.453048 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 124/270] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:53 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1568 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:55.470229 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1b661ec0-641c-4dc0-b81b-15eae9aa002e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:55.476490 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1b661ec0-641c-4dc0-b81b-15eae9aa002e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:55.504694 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1b661ec0-641c-4dc0-b81b-15eae9aa002e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:55.507394 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1b661ec0-641c-4dc0-b81b-15eae9aa002e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:55.512549 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1b661ec0-641c-4dc0-b81b-15eae9aa002e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:55.513762 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1b661ec0-641c-4dc0-b81b-15eae9aa002e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:55.864099 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1b661ec0-641c-4dc0-b81b-15eae9aa002e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 200 len: 28186 microversion: 2.1 time: 0.419274 Jan 15 02:41:55.866148 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 125/271] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:41:55 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 28186 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:41:55.894667 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4edcc359-bbfd-4592-ad06-bab010cb93b4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:55.895966 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4edcc359-bbfd-4592-ad06-bab010cb93b4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:55.932201 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4edcc359-bbfd-4592-ad06-bab010cb93b4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:55.933072 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4edcc359-bbfd-4592-ad06-bab010cb93b4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:55.934623 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4edcc359-bbfd-4592-ad06-bab010cb93b4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:55.935437 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4edcc359-bbfd-4592-ad06-bab010cb93b4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:56.294333 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d83f60b2-2626-4764-b2a6-44ea231eb255 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:56.356100 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d83f60b2-2626-4764-b2a6-44ea231eb255 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1" status: 200 len: 1314 microversion: 2.1 time: 1.770276 Jan 15 02:41:56.357349 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 147/272] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:54 2021] GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1 => generated 1314 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:56.482695 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-66114a6f-b312-4ef0-a593-87aa0aaf493e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:56.485886 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-66114a6f-b312-4ef0-a593-87aa0aaf493e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:56.510081 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-66114a6f-b312-4ef0-a593-87aa0aaf493e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:56.515688 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-66114a6f-b312-4ef0-a593-87aa0aaf493e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:56.517252 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-66114a6f-b312-4ef0-a593-87aa0aaf493e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:56.527826 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-66114a6f-b312-4ef0-a593-87aa0aaf493e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:57.000277 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4edcc359-bbfd-4592-ad06-bab010cb93b4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:57.068776 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4edcc359-bbfd-4592-ad06-bab010cb93b4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:57.093879 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4edcc359-bbfd-4592-ad06-bab010cb93b4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:57.096530 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4edcc359-bbfd-4592-ad06-bab010cb93b4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1741 microversion: 2.20 time: 1.227611 Jan 15 02:41:57.097838 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 126/273] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:41:55 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1741 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:41:57.144710 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-914a0717-9d02-41c4-931f-2968cea93c91 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:57.147151 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-914a0717-9d02-41c4-931f-2968cea93c91 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:57.171003 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-914a0717-9d02-41c4-931f-2968cea93c91 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:57.172292 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-914a0717-9d02-41c4-931f-2968cea93c91 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:57.173991 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-914a0717-9d02-41c4-931f-2968cea93c91 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:57.175424 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-914a0717-9d02-41c4-931f-2968cea93c91 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:57.412380 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-66114a6f-b312-4ef0-a593-87aa0aaf493e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:57.451484 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-66114a6f-b312-4ef0-a593-87aa0aaf493e tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1568 microversion: 2.1 time: 0.973111 Jan 15 02:41:57.452961 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-914a0717-9d02-41c4-931f-2968cea93c91 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 200 len: 28477 microversion: 2.1 time: 0.333433 Jan 15 02:41:57.453821 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 148/274] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:56 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1568 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:41:57.460423 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 127/275] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:41:57 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 28477 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:41:57.481350 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c73d70e0-2a29-49a4-b2a9-2a419e7dce2c tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:57.482695 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c73d70e0-2a29-49a4-b2a9-2a419e7dce2c tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 7836b504-3cbd-48ca-8fa3-02930a6f27e1] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:57.493049 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c73d70e0-2a29-49a4-b2a9-2a419e7dce2c tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:57.493971 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c73d70e0-2a29-49a4-b2a9-2a419e7dce2c tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:57.495340 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c73d70e0-2a29-49a4-b2a9-2a419e7dce2c tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:57.495999 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c73d70e0-2a29-49a4-b2a9-2a419e7dce2c tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:58.152718 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-147d1f8b-7f2d-444c-b761-cca07c05baa6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:58.155707 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-147d1f8b-7f2d-444c-b761-cca07c05baa6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:58.187593 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-147d1f8b-7f2d-444c-b761-cca07c05baa6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:58.188322 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-147d1f8b-7f2d-444c-b761-cca07c05baa6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:58.189419 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-147d1f8b-7f2d-444c-b761-cca07c05baa6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:58.190627 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-147d1f8b-7f2d-444c-b761-cca07c05baa6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:58.217756 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c73d70e0-2a29-49a4-b2a9-2a419e7dce2c tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:58.251039 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c73d70e0-2a29-49a4-b2a9-2a419e7dce2c tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1" status: 200 len: 1314 microversion: 2.1 time: 0.795039 Jan 15 02:41:58.254613 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 149/276] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:57 2021] GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1 => generated 1314 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:58.301227 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-0b2ccd2c-01b7-48b7-a49b-d22fee4ebc00 req-0292aece-e68d-4a47-827d-0aec8a91b517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7836b504-3cbd-48ca-8fa3-02930a6f27e1", "tag": "75821eba-37b6-4a8a-a24a-e84932b88e68"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:58.325051 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:41:58.325051 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:41:58.345476 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-0b2ccd2c-01b7-48b7-a49b-d22fee4ebc00 req-0292aece-e68d-4a47-827d-0aec8a91b517 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:58.346543 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-0b2ccd2c-01b7-48b7-a49b-d22fee4ebc00 req-0292aece-e68d-4a47-827d-0aec8a91b517 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:58.399621 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-0b2ccd2c-01b7-48b7-a49b-d22fee4ebc00 req-0292aece-e68d-4a47-827d-0aec8a91b517 service nova] Creating event network-changed:75821eba-37b6-4a8a-a24a-e84932b88e68 for instance 7836b504-3cbd-48ca-8fa3-02930a6f27e1 on hv-cinder-76330 Jan 15 02:41:58.411363 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-0b2ccd2c-01b7-48b7-a49b-d22fee4ebc00 req-0292aece-e68d-4a47-827d-0aec8a91b517 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154386 Jan 15 02:41:58.417067 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 150/277] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:41:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:41:58.493208 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-04aed965-89fc-4805-8afd-3fd32c7e0bd0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:58.497250 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-04aed965-89fc-4805-8afd-3fd32c7e0bd0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:58.515388 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-04aed965-89fc-4805-8afd-3fd32c7e0bd0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:58.516782 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-04aed965-89fc-4805-8afd-3fd32c7e0bd0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:58.518832 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-04aed965-89fc-4805-8afd-3fd32c7e0bd0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:58.521120 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-04aed965-89fc-4805-8afd-3fd32c7e0bd0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:58.787113 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-147d1f8b-7f2d-444c-b761-cca07c05baa6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:58.806206 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-147d1f8b-7f2d-444c-b761-cca07c05baa6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:58.815720 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-147d1f8b-7f2d-444c-b761-cca07c05baa6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:58.817670 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-147d1f8b-7f2d-444c-b761-cca07c05baa6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1741 microversion: 2.20 time: 0.684913 Jan 15 02:41:58.818714 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 128/278] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:41:58 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1741 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:41:58.827632 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-04aed965-89fc-4805-8afd-3fd32c7e0bd0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 200 len: 28645 microversion: 2.1 time: 0.361159 Jan 15 02:41:58.828584 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 151/279] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:41:58 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 28645 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:41:58.834640 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2d26889a-c0dd-475b-a083-5869212a3f17 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:58.835586 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2d26889a-c0dd-475b-a083-5869212a3f17 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:58.844134 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2d26889a-c0dd-475b-a083-5869212a3f17 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:58.844943 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2d26889a-c0dd-475b-a083-5869212a3f17 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:58.850252 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2d26889a-c0dd-475b-a083-5869212a3f17 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:58.852335 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2d26889a-c0dd-475b-a083-5869212a3f17 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:59.183804 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-2d26889a-c0dd-475b-a083-5869212a3f17 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:41:59.197369 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2d26889a-c0dd-475b-a083-5869212a3f17 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1568 microversion: 2.1 time: 0.377239 Jan 15 02:41:59.198535 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 129/280] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:58 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1568 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:41:59.296557 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ec16a5b0-c6eb-43e3-a15d-906a9114d621 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:41:59.297775 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ec16a5b0-c6eb-43e3-a15d-906a9114d621 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 7836b504-3cbd-48ca-8fa3-02930a6f27e1] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:59.309609 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ec16a5b0-c6eb-43e3-a15d-906a9114d621 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:59.310555 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ec16a5b0-c6eb-43e3-a15d-906a9114d621 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:59.311672 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ec16a5b0-c6eb-43e3-a15d-906a9114d621 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:59.312391 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ec16a5b0-c6eb-43e3-a15d-906a9114d621 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:59.848762 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3402c8b6-a124-4e0d-9aaf-1bd81659732e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:41:59.850208 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3402c8b6-a124-4e0d-9aaf-1bd81659732e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:41:59.868988 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3402c8b6-a124-4e0d-9aaf-1bd81659732e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:59.870174 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3402c8b6-a124-4e0d-9aaf-1bd81659732e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:41:59.871288 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3402c8b6-a124-4e0d-9aaf-1bd81659732e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:41:59.871786 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3402c8b6-a124-4e0d-9aaf-1bd81659732e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:00.068991 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3402c8b6-a124-4e0d-9aaf-1bd81659732e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 200 len: 28645 microversion: 2.1 time: 0.231045 Jan 15 02:42:00.070963 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 130/281] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:41:59 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 28645 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 02:42:00.116305 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5c8fea98-c45d-4cc1-9eb4-7315f9839ea7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:00.118425 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5c8fea98-c45d-4cc1-9eb4-7315f9839ea7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:00.149669 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5c8fea98-c45d-4cc1-9eb4-7315f9839ea7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:00.150605 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5c8fea98-c45d-4cc1-9eb4-7315f9839ea7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:00.152189 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5c8fea98-c45d-4cc1-9eb4-7315f9839ea7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:00.153104 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5c8fea98-c45d-4cc1-9eb4-7315f9839ea7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:00.373662 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-ec16a5b0-c6eb-43e3-a15d-906a9114d621 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:00.408145 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ec16a5b0-c6eb-43e3-a15d-906a9114d621 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1" status: 200 len: 1314 microversion: 2.1 time: 1.124573 Jan 15 02:42:00.409352 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 152/282] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:41:59 2021] GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1 => generated 1314 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:42:00.470074 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-28e10075-f1e2-4e36-a5d8-b6e963b1bf2b tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:00.470074 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-28e10075-f1e2-4e36-a5d8-b6e963b1bf2b tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:00.487284 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-28e10075-f1e2-4e36-a5d8-b6e963b1bf2b tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:00.488139 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-28e10075-f1e2-4e36-a5d8-b6e963b1bf2b tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:00.489616 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-28e10075-f1e2-4e36-a5d8-b6e963b1bf2b tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:00.490887 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-28e10075-f1e2-4e36-a5d8-b6e963b1bf2b tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:01.582557 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-5c8fea98-c45d-4cc1-9eb4-7315f9839ea7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:01.682397 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-5c8fea98-c45d-4cc1-9eb4-7315f9839ea7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:01.699245 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-5c8fea98-c45d-4cc1-9eb4-7315f9839ea7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:01.704076 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5c8fea98-c45d-4cc1-9eb4-7315f9839ea7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1723 microversion: 2.20 time: 1.630451 Jan 15 02:42:01.721730 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 131/283] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:42:00 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1723 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:42:01.745267 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-82a36cb2-998c-4884-9640-f0f7abc6f358 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:01.747607 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-82a36cb2-998c-4884-9640-f0f7abc6f358 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:01.767370 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-82a36cb2-998c-4884-9640-f0f7abc6f358 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:01.769042 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-82a36cb2-998c-4884-9640-f0f7abc6f358 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:01.771216 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-82a36cb2-998c-4884-9640-f0f7abc6f358 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:01.772670 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-82a36cb2-998c-4884-9640-f0f7abc6f358 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:01.828201 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-28e10075-f1e2-4e36-a5d8-b6e963b1bf2b tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:01.849575 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-28e10075-f1e2-4e36-a5d8-b6e963b1bf2b tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1568 microversion: 2.1 time: 1.438586 Jan 15 02:42:01.854482 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 153/284] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:00 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1568 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:01.878435 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4cae8e53-9a80-4be4-9cb4-faf95bfd2bfc tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:01.879117 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4cae8e53-9a80-4be4-9cb4-faf95bfd2bfc tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 7836b504-3cbd-48ca-8fa3-02930a6f27e1] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:01.901862 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4cae8e53-9a80-4be4-9cb4-faf95bfd2bfc tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:01.902338 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4cae8e53-9a80-4be4-9cb4-faf95bfd2bfc tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:01.903389 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4cae8e53-9a80-4be4-9cb4-faf95bfd2bfc tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:01.904034 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4cae8e53-9a80-4be4-9cb4-faf95bfd2bfc tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:02.015628 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-82a36cb2-998c-4884-9640-f0f7abc6f358 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 200 len: 28645 microversion: 2.1 time: 0.290860 Jan 15 02:42:02.020603 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 132/285] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:42:01 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 28645 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:42:02.566060 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4cae8e53-9a80-4be4-9cb4-faf95bfd2bfc tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:02.606737 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4cae8e53-9a80-4be4-9cb4-faf95bfd2bfc tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1" status: 200 len: 1314 microversion: 2.1 time: 0.751170 Jan 15 02:42:02.618905 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 154/286] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:01 2021] GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1 => generated 1314 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:02.776121 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-fc6eb4f4-3b7d-4a2b-93e6-7d302d64a1c0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:02.791268 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-fc6eb4f4-3b7d-4a2b-93e6-7d302d64a1c0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:02.819934 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fc6eb4f4-3b7d-4a2b-93e6-7d302d64a1c0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:02.821384 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fc6eb4f4-3b7d-4a2b-93e6-7d302d64a1c0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:02.823449 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fc6eb4f4-3b7d-4a2b-93e6-7d302d64a1c0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:02.824622 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fc6eb4f4-3b7d-4a2b-93e6-7d302d64a1c0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:02.928178 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3a60807b-2de5-4558-8ef5-e4c37f2d09f9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:02.938272 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3a60807b-2de5-4558-8ef5-e4c37f2d09f9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:02.978768 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a60807b-2de5-4558-8ef5-e4c37f2d09f9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:02.980104 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a60807b-2de5-4558-8ef5-e4c37f2d09f9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:02.982255 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a60807b-2de5-4558-8ef5-e4c37f2d09f9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:02.990300 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a60807b-2de5-4558-8ef5-e4c37f2d09f9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:03.682713 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3a60807b-2de5-4558-8ef5-e4c37f2d09f9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:03.761967 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3a60807b-2de5-4558-8ef5-e4c37f2d09f9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1568 microversion: 2.1 time: 0.864682 Jan 15 02:42:03.765831 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 155/287] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:02 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1568 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:42:03.810709 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f5902f94-71bd-45cf-9483-93da7021a0ef tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:03.813375 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f5902f94-71bd-45cf-9483-93da7021a0ef tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:03.843397 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f5902f94-71bd-45cf-9483-93da7021a0ef tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:03.844035 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f5902f94-71bd-45cf-9483-93da7021a0ef tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:03.845544 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f5902f94-71bd-45cf-9483-93da7021a0ef tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:03.846991 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f5902f94-71bd-45cf-9483-93da7021a0ef tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:04.090410 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f5902f94-71bd-45cf-9483-93da7021a0ef tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 200 len: 28968 microversion: 2.1 time: 0.321907 Jan 15 02:42:04.091706 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 156/288] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:42:03 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 28968 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:42:04.116258 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1ab4db4a-7da6-4573-92a7-bc679d59fab2 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:04.125103 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1ab4db4a-7da6-4573-92a7-bc679d59fab2 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 7836b504-3cbd-48ca-8fa3-02930a6f27e1] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:04.155739 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1ab4db4a-7da6-4573-92a7-bc679d59fab2 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:04.157950 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1ab4db4a-7da6-4573-92a7-bc679d59fab2 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:04.160377 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1ab4db4a-7da6-4573-92a7-bc679d59fab2 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:04.162528 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1ab4db4a-7da6-4573-92a7-bc679d59fab2 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:04.308885 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-fc6eb4f4-3b7d-4a2b-93e6-7d302d64a1c0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:04.340380 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-fc6eb4f4-3b7d-4a2b-93e6-7d302d64a1c0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:04.349460 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-fc6eb4f4-3b7d-4a2b-93e6-7d302d64a1c0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:04.353555 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-fc6eb4f4-3b7d-4a2b-93e6-7d302d64a1c0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1723 microversion: 2.20 time: 1.617783 Jan 15 02:42:04.365029 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 133/289] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:42:02 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1723 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:42:04.402199 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-8fb28cd8-d184-487c-914a-27af23aa79b5 req-58157d94-85ee-439c-955d-758fac2956a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7836b504-3cbd-48ca-8fa3-02930a6f27e1", "name": "network-vif-plugged", "status": "completed", "tag": "75821eba-37b6-4a8a-a24a-e84932b88e68"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:04.416704 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:42:04.416704 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:42:04.505096 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-8fb28cd8-d184-487c-914a-27af23aa79b5 req-58157d94-85ee-439c-955d-758fac2956a1 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:04.511367 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-8fb28cd8-d184-487c-914a-27af23aa79b5 req-58157d94-85ee-439c-955d-758fac2956a1 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:04.598428 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-8fb28cd8-d184-487c-914a-27af23aa79b5 req-58157d94-85ee-439c-955d-758fac2956a1 service nova] Creating event network-vif-plugged:75821eba-37b6-4a8a-a24a-e84932b88e68 for instance 7836b504-3cbd-48ca-8fa3-02930a6f27e1 on hv-cinder-76330 Jan 15 02:42:04.608739 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-8fb28cd8-d184-487c-914a-27af23aa79b5 req-58157d94-85ee-439c-955d-758fac2956a1 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239413 Jan 15 02:42:04.609567 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 134/290] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:42:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:42:04.621878 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1ab4db4a-7da6-4573-92a7-bc679d59fab2 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:04.636984 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1ab4db4a-7da6-4573-92a7-bc679d59fab2 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1" status: 200 len: 1314 microversion: 2.1 time: 0.543446 Jan 15 02:42:04.645057 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 157/291] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:04 2021] GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1 => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:04.809405 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-54e837fd-83b2-4343-9c39-486a0a196a5d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:04.813154 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-54e837fd-83b2-4343-9c39-486a0a196a5d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:04.833319 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-54e837fd-83b2-4343-9c39-486a0a196a5d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:04.834450 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-54e837fd-83b2-4343-9c39-486a0a196a5d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:04.836564 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-54e837fd-83b2-4343-9c39-486a0a196a5d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:04.837649 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-54e837fd-83b2-4343-9c39-486a0a196a5d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:05.127220 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-8a629223-e929-4c15-b067-58880caed75d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:05.129596 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8a629223-e929-4c15-b067-58880caed75d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:05.144335 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8a629223-e929-4c15-b067-58880caed75d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:05.144953 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8a629223-e929-4c15-b067-58880caed75d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:05.146868 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8a629223-e929-4c15-b067-58880caed75d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:05.147873 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8a629223-e929-4c15-b067-58880caed75d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:05.367948 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-8a629223-e929-4c15-b067-58880caed75d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 200 len: 30314 microversion: 2.1 time: 0.264053 Jan 15 02:42:05.369915 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 158/292] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:42:05 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 30314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:42:05.416254 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-19f363b0-1f39-4a67-95f9-1e0b77273585 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:05.418745 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-19f363b0-1f39-4a67-95f9-1e0b77273585 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:05.436544 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-19f363b0-1f39-4a67-95f9-1e0b77273585 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:05.437508 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-19f363b0-1f39-4a67-95f9-1e0b77273585 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:05.439255 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-19f363b0-1f39-4a67-95f9-1e0b77273585 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:05.440359 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-19f363b0-1f39-4a67-95f9-1e0b77273585 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:05.552858 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-54e837fd-83b2-4343-9c39-486a0a196a5d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:05.565516 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-54e837fd-83b2-4343-9c39-486a0a196a5d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1568 microversion: 2.1 time: 0.768517 Jan 15 02:42:05.568204 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 135/293] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:04 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1568 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:05.675194 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7c88f61d-b4bb-43bd-962f-0e14e0df0806 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:05.676696 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-7c88f61d-b4bb-43bd-962f-0e14e0df0806 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 7836b504-3cbd-48ca-8fa3-02930a6f27e1] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:05.687971 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7c88f61d-b4bb-43bd-962f-0e14e0df0806 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:05.689188 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7c88f61d-b4bb-43bd-962f-0e14e0df0806 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:05.690459 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7c88f61d-b4bb-43bd-962f-0e14e0df0806 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:05.691170 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7c88f61d-b4bb-43bd-962f-0e14e0df0806 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:06.084381 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-7c88f61d-b4bb-43bd-962f-0e14e0df0806 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:06.096429 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-7c88f61d-b4bb-43bd-962f-0e14e0df0806 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1" status: 200 len: 1314 microversion: 2.1 time: 0.443096 Jan 15 02:42:06.097516 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 136/294] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:05 2021] GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:06.100423 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-19f363b0-1f39-4a67-95f9-1e0b77273585 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:06.117706 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-19f363b0-1f39-4a67-95f9-1e0b77273585 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:06.128765 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-19f363b0-1f39-4a67-95f9-1e0b77273585 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:06.130455 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-19f363b0-1f39-4a67-95f9-1e0b77273585 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1723 microversion: 2.20 time: 0.740709 Jan 15 02:42:06.131119 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 159/295] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:42:05 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1723 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:42:06.395504 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-0e0d1a46-6fea-4726-8def-d1a48482e501 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:06.397210 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-0e0d1a46-6fea-4726-8def-d1a48482e501 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:06.407291 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0e0d1a46-6fea-4726-8def-d1a48482e501 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:06.408394 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0e0d1a46-6fea-4726-8def-d1a48482e501 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:06.409539 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0e0d1a46-6fea-4726-8def-d1a48482e501 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:06.410297 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0e0d1a46-6fea-4726-8def-d1a48482e501 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:06.586387 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-0e0d1a46-6fea-4726-8def-d1a48482e501 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 200 len: 31426 microversion: 2.1 time: 0.203642 Jan 15 02:42:06.608531 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 137/296] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:42:06 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 31426 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:42:06.639872 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b32c35ec-f5b1-4009-8898-dabe928fbbf6 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:06.641494 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b32c35ec-f5b1-4009-8898-dabe928fbbf6 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:06.711529 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b32c35ec-f5b1-4009-8898-dabe928fbbf6 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:06.713110 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b32c35ec-f5b1-4009-8898-dabe928fbbf6 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:06.715236 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b32c35ec-f5b1-4009-8898-dabe928fbbf6 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:06.716368 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b32c35ec-f5b1-4009-8898-dabe928fbbf6 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:07.170484 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-0bbe271c-2c04-4217-8b9a-a57bc06931e1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:07.187587 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-0bbe271c-2c04-4217-8b9a-a57bc06931e1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 7836b504-3cbd-48ca-8fa3-02930a6f27e1] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:07.252688 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0bbe271c-2c04-4217-8b9a-a57bc06931e1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:07.256960 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0bbe271c-2c04-4217-8b9a-a57bc06931e1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:07.260224 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0bbe271c-2c04-4217-8b9a-a57bc06931e1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:07.264366 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0bbe271c-2c04-4217-8b9a-a57bc06931e1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:07.797240 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b32c35ec-f5b1-4009-8898-dabe928fbbf6 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:07.834511 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b32c35ec-f5b1-4009-8898-dabe928fbbf6 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1568 microversion: 2.1 time: 1.246821 Jan 15 02:42:07.835954 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 160/297] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:06 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1568 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:42:07.855686 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b62cbc87-34c3-46b2-9315-6f53c177e830 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:07.856643 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b62cbc87-34c3-46b2-9315-6f53c177e830 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:07.880270 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b62cbc87-34c3-46b2-9315-6f53c177e830 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:07.882705 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b62cbc87-34c3-46b2-9315-6f53c177e830 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:07.884350 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b62cbc87-34c3-46b2-9315-6f53c177e830 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:07.885784 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b62cbc87-34c3-46b2-9315-6f53c177e830 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:08.232240 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0bbe271c-2c04-4217-8b9a-a57bc06931e1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:08.244195 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-0bbe271c-2c04-4217-8b9a-a57bc06931e1 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1" status: 200 len: 1498 microversion: 2.1 time: 1.122572 Jan 15 02:42:08.244819 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 138/298] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:07 2021] GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1 => generated 1498 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:08.292691 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c6796cb7-0b41-4eb9-bf17-02996db9be3b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:08.293839 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c6796cb7-0b41-4eb9-bf17-02996db9be3b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:08.316359 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c6796cb7-0b41-4eb9-bf17-02996db9be3b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:08.316829 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c6796cb7-0b41-4eb9-bf17-02996db9be3b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:08.317816 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c6796cb7-0b41-4eb9-bf17-02996db9be3b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:08.328696 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c6796cb7-0b41-4eb9-bf17-02996db9be3b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:08.592045 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c6796cb7-0b41-4eb9-bf17-02996db9be3b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 200 len: 33018 microversion: 2.1 time: 0.322636 Jan 15 02:42:08.618575 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 139/299] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:42:08 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 33018 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:42:08.875357 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-fc59afeb-ae5d-452b-b6a0-d08f7bdf1485 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:08.876626 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-fc59afeb-ae5d-452b-b6a0-d08f7bdf1485 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:08.888191 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fc59afeb-ae5d-452b-b6a0-d08f7bdf1485 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:08.889099 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fc59afeb-ae5d-452b-b6a0-d08f7bdf1485 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:08.890235 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fc59afeb-ae5d-452b-b6a0-d08f7bdf1485 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:08.890952 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fc59afeb-ae5d-452b-b6a0-d08f7bdf1485 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:09.082223 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b62cbc87-34c3-46b2-9315-6f53c177e830 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:09.148215 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b62cbc87-34c3-46b2-9315-6f53c177e830 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:09.203616 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b62cbc87-34c3-46b2-9315-6f53c177e830 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:09.214244 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b62cbc87-34c3-46b2-9315-6f53c177e830 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1726 microversion: 2.20 time: 1.376187 Jan 15 02:42:09.222318 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 161/300] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:42:07 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1726 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:42:09.260315 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-21ad8405-02c7-4617-9ca2-2ebffa34f6ee tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1025b8fc-e5fb-4098-8975-0c436ec4d456"}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:09.266933 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-21ad8405-02c7-4617-9ca2-2ebffa34f6ee tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:09.284992 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-21ad8405-02c7-4617-9ca2-2ebffa34f6ee tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:09.287077 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-21ad8405-02c7-4617-9ca2-2ebffa34f6ee tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:09.291817 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-21ad8405-02c7-4617-9ca2-2ebffa34f6ee tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:09.293105 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-21ad8405-02c7-4617-9ca2-2ebffa34f6ee tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:09.562987 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-fc59afeb-ae5d-452b-b6a0-d08f7bdf1485 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:09.588849 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-fc59afeb-ae5d-452b-b6a0-d08f7bdf1485 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1568 microversion: 2.1 time: 0.723659 Jan 15 02:42:09.604753 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 140/301] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:08 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1568 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:09.615995 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-f0a6c753-2785-4134-a9b5-75099d93b2df req-16f3aca4-3b86-421b-b809-d7c6dd3bf6f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a86e56-4ee0-4098-98bb-7deac49ba1aa", "name": "network-vif-unplugged", "status": "completed", "tag": "a3bc182a-ab0e-4f1a-9e0f-958740ed4222"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:09.653729 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:42:09.653729 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:42:09.691083 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-f0a6c753-2785-4134-a9b5-75099d93b2df req-16f3aca4-3b86-421b-b809-d7c6dd3bf6f6 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:09.691567 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-f0a6c753-2785-4134-a9b5-75099d93b2df req-16f3aca4-3b86-421b-b809-d7c6dd3bf6f6 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:09.731647 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.compute.server_external_events [req-f0a6c753-2785-4134-a9b5-75099d93b2df req-16f3aca4-3b86-421b-b809-d7c6dd3bf6f6 service nova] Unable to find a host for instance a8a86e56-4ee0-4098-98bb-7deac49ba1aa. Dropping event network-vif-unplugged {{(pid=94112) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Jan 15 02:42:09.733208 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-f0a6c753-2785-4134-a9b5-75099d93b2df req-16f3aca4-3b86-421b-b809-d7c6dd3bf6f6 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.127229 Jan 15 02:42:09.734404 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 141/302] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:42:09 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 129 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 15 02:42:09.747048 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-212cfc91-6987-4cb8-b5b8-0a4892568d2d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:09.748351 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-212cfc91-6987-4cb8-b5b8-0a4892568d2d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:09.757761 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-212cfc91-6987-4cb8-b5b8-0a4892568d2d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:09.758712 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-212cfc91-6987-4cb8-b5b8-0a4892568d2d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:09.760828 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-212cfc91-6987-4cb8-b5b8-0a4892568d2d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:09.761571 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-212cfc91-6987-4cb8-b5b8-0a4892568d2d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:10.020251 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-212cfc91-6987-4cb8-b5b8-0a4892568d2d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 200 len: 34727 microversion: 2.1 time: 0.284001 Jan 15 02:42:10.023956 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 142/303] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:42:09 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 34727 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:42:10.042308 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6512c0aa-a46d-4538-b3b2-2dc8c62b36e4 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:10.043153 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6512c0aa-a46d-4538-b3b2-2dc8c62b36e4 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 7836b504-3cbd-48ca-8fa3-02930a6f27e1] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:10.057918 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6512c0aa-a46d-4538-b3b2-2dc8c62b36e4 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:10.058588 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6512c0aa-a46d-4538-b3b2-2dc8c62b36e4 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:10.059610 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6512c0aa-a46d-4538-b3b2-2dc8c62b36e4 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:10.066918 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6512c0aa-a46d-4538-b3b2-2dc8c62b36e4 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:10.184198 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6512c0aa-a46d-4538-b3b2-2dc8c62b36e4 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 7836b504-3cbd-48ca-8fa3-02930a6f27e1] Going to try to terminate instance {{(pid=94112) delete /opt/stack/nova/nova/compute/api.py:2535}} Jan 15 02:42:10.423845 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-21ad8405-02c7-4617-9ca2-2ebffa34f6ee tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.185543 Jan 15 02:42:10.429452 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 162/304] 10.222.0.37 () {62 vars in 1354 bytes} [Fri Jan 15 02:42:09 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/os-volume_attachments => generated 188 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:42:10.468803 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6512c0aa-a46d-4538-b3b2-2dc8c62b36e4 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "DELETE /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1" status: 204 len: 0 microversion: 2.1 time: 0.439630 Jan 15 02:42:10.469633 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 143/305] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:42:10 2021] DELETE /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 02:42:10.490627 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ee312389-1d3d-4081-8178-624b34bbffe5 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:10.491317 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ee312389-1d3d-4081-8178-624b34bbffe5 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 7836b504-3cbd-48ca-8fa3-02930a6f27e1] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:10.516683 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ee312389-1d3d-4081-8178-624b34bbffe5 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:10.517243 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ee312389-1d3d-4081-8178-624b34bbffe5 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:10.529298 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ee312389-1d3d-4081-8178-624b34bbffe5 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:10.529579 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ee312389-1d3d-4081-8178-624b34bbffe5 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:10.634755 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c7fbb94f-2066-4894-ab40-364f5ee4b01f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:10.636195 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c7fbb94f-2066-4894-ab40-364f5ee4b01f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:10.650477 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c7fbb94f-2066-4894-ab40-364f5ee4b01f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:10.651437 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c7fbb94f-2066-4894-ab40-364f5ee4b01f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:10.652681 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c7fbb94f-2066-4894-ab40-364f5ee4b01f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:10.653396 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c7fbb94f-2066-4894-ab40-364f5ee4b01f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:11.026564 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c7fbb94f-2066-4894-ab40-364f5ee4b01f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:11.045931 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c7fbb94f-2066-4894-ab40-364f5ee4b01f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1568 microversion: 2.1 time: 0.437177 Jan 15 02:42:11.047088 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 144/306] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:10 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1568 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:11.060849 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-bac6870b-0363-4e36-8691-7abfba56e92b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:11.062782 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-bac6870b-0363-4e36-8691-7abfba56e92b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:11.076811 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bac6870b-0363-4e36-8691-7abfba56e92b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:11.078240 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bac6870b-0363-4e36-8691-7abfba56e92b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:11.079101 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bac6870b-0363-4e36-8691-7abfba56e92b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:11.079708 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bac6870b-0363-4e36-8691-7abfba56e92b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:11.527669 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-ee312389-1d3d-4081-8178-624b34bbffe5 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:11.549937 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ee312389-1d3d-4081-8178-624b34bbffe5 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1" status: 200 len: 1504 microversion: 2.1 time: 1.074237 Jan 15 02:42:11.551211 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 163/307] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:10 2021] GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1 => generated 1504 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:11.575041 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-da778848-6d56-4bc8-b1fa-d881222e2dda tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:11.577183 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-da778848-6d56-4bc8-b1fa-d881222e2dda tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:11.598512 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-bac6870b-0363-4e36-8691-7abfba56e92b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action" status: 202 len: 0 microversion: 2.20 time: 0.549864 Jan 15 02:42:11.599432 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 145/308] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:42:11 2021] POST /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/action => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 15 02:42:11.607125 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-da778848-6d56-4bc8-b1fa-d881222e2dda tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:11.608201 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-da778848-6d56-4bc8-b1fa-d881222e2dda tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:11.609614 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-da778848-6d56-4bc8-b1fa-d881222e2dda tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:11.610415 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-da778848-6d56-4bc8-b1fa-d881222e2dda tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:11.652663 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-23ddbff9-2ec4-4a94-88ca-b15958ac1c69 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:11.661074 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-23ddbff9-2ec4-4a94-88ca-b15958ac1c69 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:11.691807 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-23ddbff9-2ec4-4a94-88ca-b15958ac1c69 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:11.692673 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-23ddbff9-2ec4-4a94-88ca-b15958ac1c69 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:11.693776 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-23ddbff9-2ec4-4a94-88ca-b15958ac1c69 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:11.694458 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-23ddbff9-2ec4-4a94-88ca-b15958ac1c69 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:11.919205 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-da778848-6d56-4bc8-b1fa-d881222e2dda tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 200 len: 36271 microversion: 2.1 time: 0.365930 Jan 15 02:42:11.920047 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 164/309] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:42:11 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 36271 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:42:12.079763 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a8400a25-38e5-4a0c-8dbf-3d46c4bc50b9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:12.089252 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a8400a25-38e5-4a0c-8dbf-3d46c4bc50b9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:12.122228 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a8400a25-38e5-4a0c-8dbf-3d46c4bc50b9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:12.122761 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a8400a25-38e5-4a0c-8dbf-3d46c4bc50b9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:12.123679 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a8400a25-38e5-4a0c-8dbf-3d46c4bc50b9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:12.124189 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a8400a25-38e5-4a0c-8dbf-3d46c4bc50b9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:12.193941 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-23ddbff9-2ec4-4a94-88ca-b15958ac1c69 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:12.239698 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-23ddbff9-2ec4-4a94-88ca-b15958ac1c69 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:12.261401 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-23ddbff9-2ec4-4a94-88ca-b15958ac1c69 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:12.274964 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-23ddbff9-2ec4-4a94-88ca-b15958ac1c69 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1752 microversion: 2.20 time: 0.664137 Jan 15 02:42:12.276547 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 146/310] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:42:11 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1752 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:42:12.585957 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-0a4742ff-84d5-424b-80ea-34673978ffb5 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:12.591878 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-0a4742ff-84d5-424b-80ea-34673978ffb5 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 7836b504-3cbd-48ca-8fa3-02930a6f27e1] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:12.618847 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0a4742ff-84d5-424b-80ea-34673978ffb5 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:12.624119 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0a4742ff-84d5-424b-80ea-34673978ffb5 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:12.625340 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0a4742ff-84d5-424b-80ea-34673978ffb5 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:12.626579 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0a4742ff-84d5-424b-80ea-34673978ffb5 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:12.845488 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a8400a25-38e5-4a0c-8dbf-3d46c4bc50b9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:12.874305 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a8400a25-38e5-4a0c-8dbf-3d46c4bc50b9 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1568 microversion: 2.1 time: 0.806370 Jan 15 02:42:12.882308 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 165/311] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:12 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1568 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:12.944645 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-04541739-cc4f-43f0-b34c-3733f7915b80 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:12.948380 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-04541739-cc4f-43f0-b34c-3733f7915b80 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:12.967445 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-04541739-cc4f-43f0-b34c-3733f7915b80 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:12.971681 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-04541739-cc4f-43f0-b34c-3733f7915b80 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:12.974406 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-04541739-cc4f-43f0-b34c-3733f7915b80 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:12.979324 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-04541739-cc4f-43f0-b34c-3733f7915b80 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:13.184919 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-04541739-cc4f-43f0-b34c-3733f7915b80 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 200 len: 36978 microversion: 2.1 time: 0.253178 Jan 15 02:42:13.189228 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 166/312] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:42:12 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 36978 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 02:42:13.303185 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-181b393d-ae67-49e2-9189-e160c0345dbb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:13.304050 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-181b393d-ae67-49e2-9189-e160c0345dbb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:13.326486 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-181b393d-ae67-49e2-9189-e160c0345dbb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:13.326765 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-181b393d-ae67-49e2-9189-e160c0345dbb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:13.327650 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-181b393d-ae67-49e2-9189-e160c0345dbb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:13.328148 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-181b393d-ae67-49e2-9189-e160c0345dbb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:14.209152 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-181b393d-ae67-49e2-9189-e160c0345dbb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:14.251208 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-181b393d-ae67-49e2-9189-e160c0345dbb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:14.258897 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-181b393d-ae67-49e2-9189-e160c0345dbb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:14.264019 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-181b393d-ae67-49e2-9189-e160c0345dbb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1752 microversion: 2.20 time: 0.970738 Jan 15 02:42:14.265248 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 167/313] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:42:13 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1752 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:42:14.284158 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-18fae7ed-5908-406f-8e1a-23f6ec5a0752 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:14.289975 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-18fae7ed-5908-406f-8e1a-23f6ec5a0752 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:14.310865 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-18fae7ed-5908-406f-8e1a-23f6ec5a0752 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:14.311812 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-18fae7ed-5908-406f-8e1a-23f6ec5a0752 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:14.312917 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-18fae7ed-5908-406f-8e1a-23f6ec5a0752 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:14.316727 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-18fae7ed-5908-406f-8e1a-23f6ec5a0752 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:15.000364 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-18fae7ed-5908-406f-8e1a-23f6ec5a0752 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:15.032300 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-18fae7ed-5908-406f-8e1a-23f6ec5a0752 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1548 microversion: 2.1 time: 0.765658 Jan 15 02:42:15.032937 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 168/314] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:14 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1548 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:15.067145 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-06ce462e-3705-4f0e-8f15-c15d8afa6da2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:15.068437 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-06ce462e-3705-4f0e-8f15-c15d8afa6da2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:15.089389 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-06ce462e-3705-4f0e-8f15-c15d8afa6da2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:15.090118 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-06ce462e-3705-4f0e-8f15-c15d8afa6da2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:15.093502 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-06ce462e-3705-4f0e-8f15-c15d8afa6da2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:15.094281 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-06ce462e-3705-4f0e-8f15-c15d8afa6da2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:15.295938 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-06ce462e-3705-4f0e-8f15-c15d8afa6da2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 200 len: 38150 microversion: 2.1 time: 0.261102 Jan 15 02:42:15.298097 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 169/315] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:42:15 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 38150 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:42:15.313792 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-5ffd86ec-d704-4d2b-89a6-50078522afbf req-2f9b638e-938d-437f-92c6-4a9b9caa1f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7836b504-3cbd-48ca-8fa3-02930a6f27e1", "name": "network-vif-unplugged", "status": "completed", "tag": "75821eba-37b6-4a8a-a24a-e84932b88e68"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:15.322639 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:42:15.322639 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:42:15.336391 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-5ffd86ec-d704-4d2b-89a6-50078522afbf req-2f9b638e-938d-437f-92c6-4a9b9caa1f28 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:15.337314 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-5ffd86ec-d704-4d2b-89a6-50078522afbf req-2f9b638e-938d-437f-92c6-4a9b9caa1f28 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:15.361764 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-5ffd86ec-d704-4d2b-89a6-50078522afbf req-2f9b638e-938d-437f-92c6-4a9b9caa1f28 service nova] Creating event network-vif-unplugged:75821eba-37b6-4a8a-a24a-e84932b88e68 for instance 7836b504-3cbd-48ca-8fa3-02930a6f27e1 on hv-cinder-76330 Jan 15 02:42:15.373363 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-5ffd86ec-d704-4d2b-89a6-50078522afbf req-2f9b638e-938d-437f-92c6-4a9b9caa1f28 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072820 Jan 15 02:42:15.374631 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 170/316] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:42:15 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:42:15.389420 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2f89b9ff-1089-4e88-8e4b-9864a06e3713 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:15.390749 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2f89b9ff-1089-4e88-8e4b-9864a06e3713 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:15.402220 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2f89b9ff-1089-4e88-8e4b-9864a06e3713 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:15.403027 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2f89b9ff-1089-4e88-8e4b-9864a06e3713 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:15.404067 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2f89b9ff-1089-4e88-8e4b-9864a06e3713 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:15.404718 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2f89b9ff-1089-4e88-8e4b-9864a06e3713 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:15.701511 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0a4742ff-84d5-424b-80ea-34673978ffb5 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:15.721765 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-2f89b9ff-1089-4e88-8e4b-9864a06e3713 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] HTTP exception thrown: Cannot 'detach_volume' instance e90ce195-f423-416c-859f-a6423d99efe6 while it is in vm_state rescued Jan 15 02:42:15.722447 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2f89b9ff-1089-4e88-8e4b-9864a06e3713 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Returning 409 to user: Cannot 'detach_volume' instance e90ce195-f423-416c-859f-a6423d99efe6 while it is in vm_state rescued {{(pid=94111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:42:15.723904 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-0a4742ff-84d5-424b-80ea-34673978ffb5 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1" status: 200 len: 1504 microversion: 2.1 time: 3.156620 Jan 15 02:42:15.733802 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2f89b9ff-1089-4e88-8e4b-9864a06e3713 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "DELETE /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6/os-volume_attachments/d9c66074-4f6c-43f1-b924-f2cd6d31a27d" status: 409 len: 152 microversion: 2.1 time: 0.347312 Jan 15 02:42:15.734814 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 171/317] 10.222.0.37 () {58 vars in 1406 bytes} [Fri Jan 15 02:42:15 2021] DELETE /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6/os-volume_attachments/d9c66074-4f6c-43f1-b924-f2cd6d31a27d => generated 152 bytes in 359 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 15 02:42:15.737505 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 147/318] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:12 2021] GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1 => generated 1504 bytes in 3171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:15.758134 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c24d5c13-87d8-45fe-af39-4619a2c6ea5f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:15.759394 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c24d5c13-87d8-45fe-af39-4619a2c6ea5f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:15.778206 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c24d5c13-87d8-45fe-af39-4619a2c6ea5f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:15.778765 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c24d5c13-87d8-45fe-af39-4619a2c6ea5f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:15.779659 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c24d5c13-87d8-45fe-af39-4619a2c6ea5f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:15.780158 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c24d5c13-87d8-45fe-af39-4619a2c6ea5f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:15.794594 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-87c22f29-e76b-47e0-9582-08969a01ef70 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:15.795646 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-87c22f29-e76b-47e0-9582-08969a01ef70 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:15.810755 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-87c22f29-e76b-47e0-9582-08969a01ef70 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:15.811531 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-87c22f29-e76b-47e0-9582-08969a01ef70 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:15.812803 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-87c22f29-e76b-47e0-9582-08969a01ef70 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:15.814239 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-87c22f29-e76b-47e0-9582-08969a01ef70 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:16.056297 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-87c22f29-e76b-47e0-9582-08969a01ef70 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "POST /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6/action" status: 202 len: 0 microversion: 2.1 time: 0.311922 Jan 15 02:42:16.057484 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 148/319] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:42:15 2021] POST /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:42:16.083077 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-fbf16602-ae0b-4eae-b6fb-d867fbba177a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:16.083879 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-fbf16602-ae0b-4eae-b6fb-d867fbba177a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:16.094551 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fbf16602-ae0b-4eae-b6fb-d867fbba177a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:16.095172 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fbf16602-ae0b-4eae-b6fb-d867fbba177a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:16.096103 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fbf16602-ae0b-4eae-b6fb-d867fbba177a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:16.096661 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fbf16602-ae0b-4eae-b6fb-d867fbba177a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:16.981685 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c24d5c13-87d8-45fe-af39-4619a2c6ea5f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:17.039850 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c24d5c13-87d8-45fe-af39-4619a2c6ea5f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:17.058630 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c24d5c13-87d8-45fe-af39-4619a2c6ea5f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:17.062538 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c24d5c13-87d8-45fe-af39-4619a2c6ea5f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1754 microversion: 2.20 time: 1.326575 Jan 15 02:42:17.065365 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 172/320] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:42:15 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1754 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:42:17.095773 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3374219b-014c-4dc3-906e-d7642f4ef177 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:17.098133 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3374219b-014c-4dc3-906e-d7642f4ef177 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:17.116955 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3374219b-014c-4dc3-906e-d7642f4ef177 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:17.117838 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3374219b-014c-4dc3-906e-d7642f4ef177 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:17.119397 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3374219b-014c-4dc3-906e-d7642f4ef177 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:17.120506 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3374219b-014c-4dc3-906e-d7642f4ef177 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:17.459000 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3374219b-014c-4dc3-906e-d7642f4ef177 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 200 len: 38273 microversion: 2.1 time: 0.390863 Jan 15 02:42:17.467020 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 173/321] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:42:17 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 38273 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:42:17.482863 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2d6bf245-e79f-44c2-a78d-e13d1308428e tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:17.488859 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2d6bf245-e79f-44c2-a78d-e13d1308428e tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 7836b504-3cbd-48ca-8fa3-02930a6f27e1] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:17.513377 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2d6bf245-e79f-44c2-a78d-e13d1308428e tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:17.513377 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2d6bf245-e79f-44c2-a78d-e13d1308428e tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:17.513377 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2d6bf245-e79f-44c2-a78d-e13d1308428e tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:17.513377 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2d6bf245-e79f-44c2-a78d-e13d1308428e tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:18.497757 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-fbf16602-ae0b-4eae-b6fb-d867fbba177a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:18.518688 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-fbf16602-ae0b-4eae-b6fb-d867fbba177a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1556 microversion: 2.1 time: 2.456451 Jan 15 02:42:18.526199 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 149/322] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:16 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1556 bytes in 2465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:42:18.558173 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d1ddf585-f0e4-46f0-8e78-afb65a3368e2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:18.559259 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d1ddf585-f0e4-46f0-8e78-afb65a3368e2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:18.568576 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d1ddf585-f0e4-46f0-8e78-afb65a3368e2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:18.570061 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d1ddf585-f0e4-46f0-8e78-afb65a3368e2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:18.571274 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d1ddf585-f0e4-46f0-8e78-afb65a3368e2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:18.572023 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d1ddf585-f0e4-46f0-8e78-afb65a3368e2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:19.002214 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-2d6bf245-e79f-44c2-a78d-e13d1308428e tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:19.023588 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2d6bf245-e79f-44c2-a78d-e13d1308428e tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1" status: 200 len: 1504 microversion: 2.1 time: 1.560148 Jan 15 02:42:19.026111 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 174/323] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:17 2021] GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1 => generated 1504 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:19.075070 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2b26de43-bb50-423f-aa3a-ed157650381a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:19.077981 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2b26de43-bb50-423f-aa3a-ed157650381a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:19.099692 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2b26de43-bb50-423f-aa3a-ed157650381a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:19.100390 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2b26de43-bb50-423f-aa3a-ed157650381a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:19.105389 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2b26de43-bb50-423f-aa3a-ed157650381a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:19.105990 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2b26de43-bb50-423f-aa3a-ed157650381a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:19.326708 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2b26de43-bb50-423f-aa3a-ed157650381a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 200 len: 38281 microversion: 2.1 time: 0.285348 Jan 15 02:42:19.327617 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 175/324] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:42:19 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 38281 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:42:19.357597 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-8947c3bb-d0e5-4b40-af3e-d9ac739ee6e1 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:19.358664 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8947c3bb-d0e5-4b40-af3e-d9ac739ee6e1 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:19.372874 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8947c3bb-d0e5-4b40-af3e-d9ac739ee6e1 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:19.374004 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8947c3bb-d0e5-4b40-af3e-d9ac739ee6e1 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:19.375147 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8947c3bb-d0e5-4b40-af3e-d9ac739ee6e1 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:19.376031 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8947c3bb-d0e5-4b40-af3e-d9ac739ee6e1 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:19.497974 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-8947c3bb-d0e5-4b40-af3e-d9ac739ee6e1 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/ips" status: 200 len: 147 microversion: 2.1 time: 0.154275 Jan 15 02:42:19.499193 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 176/325] 10.222.0.37 () {58 vars in 1238 bytes} [Fri Jan 15 02:42:19 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/ips => generated 147 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:42:19.574981 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3e757620-3227-4cf3-93e6-904689f3f5c6 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:19.576076 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3e757620-3227-4cf3-93e6-904689f3f5c6 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:19.587246 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3e757620-3227-4cf3-93e6-904689f3f5c6 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:19.588107 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3e757620-3227-4cf3-93e6-904689f3f5c6 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:19.589247 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3e757620-3227-4cf3-93e6-904689f3f5c6 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:19.589998 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3e757620-3227-4cf3-93e6-904689f3f5c6 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:19.630318 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d1ddf585-f0e4-46f0-8e78-afb65a3368e2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:19.674936 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d1ddf585-f0e4-46f0-8e78-afb65a3368e2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:19.686244 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d1ddf585-f0e4-46f0-8e78-afb65a3368e2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:19.688568 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d1ddf585-f0e4-46f0-8e78-afb65a3368e2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1754 microversion: 2.20 time: 1.160928 Jan 15 02:42:19.690144 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 150/326] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:42:18 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1754 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:42:19.703669 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-9880fe5c-7d64-4743-a76c-79726567895a req-7d6637d0-c705-4719-849a-16515e5c449d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7836b504-3cbd-48ca-8fa3-02930a6f27e1", "name": "network-vif-deleted", "tag": "75821eba-37b6-4a8a-a24a-e84932b88e68"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:19.713084 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:42:19.713084 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:42:19.724397 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-9880fe5c-7d64-4743-a76c-79726567895a req-7d6637d0-c705-4719-849a-16515e5c449d service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:19.725392 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-9880fe5c-7d64-4743-a76c-79726567895a req-7d6637d0-c705-4719-849a-16515e5c449d service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:19.804623 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-9880fe5c-7d64-4743-a76c-79726567895a req-7d6637d0-c705-4719-849a-16515e5c449d service nova] Creating event network-vif-deleted:75821eba-37b6-4a8a-a24a-e84932b88e68 for instance 7836b504-3cbd-48ca-8fa3-02930a6f27e1 on hv-cinder-76330 Jan 15 02:42:19.816500 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-9880fe5c-7d64-4743-a76c-79726567895a req-7d6637d0-c705-4719-849a-16515e5c449d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124054 Jan 15 02:42:19.818085 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 151/327] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:42:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:42:19.848546 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5afbc142-0e41-41f5-8e20-81e0e50b34be tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-779223545", "imageRef": "1807a1cb-835d-4a56-8751-82ffa40b12c9", "flavorRef": "452", "networks": [{"uuid": "1ca677c7-2a66-4fff-b537-accd652409a8"}]}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:19.950361 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-5afbc142-0e41-41f5-8e20-81e0e50b34be tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] validate_networks() for [('1ca677c7-2a66-4fff-b537-accd652409a8', None, None, None)] {{(pid=94112) validate_networks /opt/stack/nova/nova/network/neutron.py:2340}} Jan 15 02:42:20.078307 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3e757620-3227-4cf3-93e6-904689f3f5c6 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:20.093673 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3e757620-3227-4cf3-93e6-904689f3f5c6 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1556 microversion: 2.1 time: 0.534585 Jan 15 02:42:20.094312 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 177/328] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:19 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1556 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:42:20.105212 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-54003b3c-4e5a-4614-9435-c1c247b03ad0 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:20.114840 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-54003b3c-4e5a-4614-9435-c1c247b03ad0 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 7836b504-3cbd-48ca-8fa3-02930a6f27e1] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:20.124084 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-54003b3c-4e5a-4614-9435-c1c247b03ad0 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:20.124593 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-54003b3c-4e5a-4614-9435-c1c247b03ad0 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:20.125485 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-54003b3c-4e5a-4614-9435-c1c247b03ad0 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:20.125980 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-54003b3c-4e5a-4614-9435-c1c247b03ad0 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:20.213320 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-54003b3c-4e5a-4614-9435-c1c247b03ad0 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:20.213831 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-54003b3c-4e5a-4614-9435-c1c247b03ad0 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:20.214422 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.objects.instance [None req-54003b3c-4e5a-4614-9435-c1c247b03ad0 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lazy-loading 'fault' on Instance uuid 7836b504-3cbd-48ca-8fa3-02930a6f27e1 {{(pid=94111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Jan 15 02:42:20.305661 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-54003b3c-4e5a-4614-9435-c1c247b03ad0 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c8449171243ed9871a947b62c02d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa87010f244e1b998f04858f116ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:20.315160 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-54003b3c-4e5a-4614-9435-c1c247b03ad0 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1" status: 200 len: 1304 microversion: 2.1 time: 0.219671 Jan 15 02:42:20.315794 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 178/329] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:20 2021] GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1 => generated 1304 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:20.718347 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-8c76063c-c83b-4283-840d-a552a7c502cf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:20.719103 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8c76063c-c83b-4283-840d-a552a7c502cf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:20.733842 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8c76063c-c83b-4283-840d-a552a7c502cf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:20.735222 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8c76063c-c83b-4283-840d-a552a7c502cf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:20.736882 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8c76063c-c83b-4283-840d-a552a7c502cf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:20.737752 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8c76063c-c83b-4283-840d-a552a7c502cf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:21.423077 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-8c76063c-c83b-4283-840d-a552a7c502cf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:21.481090 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-8c76063c-c83b-4283-840d-a552a7c502cf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:21.511695 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-8c76063c-c83b-4283-840d-a552a7c502cf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:21.514413 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-8c76063c-c83b-4283-840d-a552a7c502cf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1754 microversion: 2.20 time: 0.807900 Jan 15 02:42:21.515589 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 179/330] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:42:20 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1754 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:42:21.545372 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-8c833a0c-c1f6-4f75-868d-683a54cddc0f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:21.547098 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8c833a0c-c1f6-4f75-868d-683a54cddc0f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:21.565109 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8c833a0c-c1f6-4f75-868d-683a54cddc0f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:21.566446 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8c833a0c-c1f6-4f75-868d-683a54cddc0f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:21.568359 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8c833a0c-c1f6-4f75-868d-683a54cddc0f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:21.570306 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8c833a0c-c1f6-4f75-868d-683a54cddc0f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:22.150426 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-8c833a0c-c1f6-4f75-868d-683a54cddc0f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:22.161566 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-8c833a0c-c1f6-4f75-868d-683a54cddc0f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1562 microversion: 2.1 time: 0.644220 Jan 15 02:42:22.162721 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 180/331] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:21 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1562 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:22.174419 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5ad436ed-c0cc-4a85-8379-f44c78c22fd6 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:22.175460 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5ad436ed-c0cc-4a85-8379-f44c78c22fd6 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] [instance: 7836b504-3cbd-48ca-8fa3-02930a6f27e1] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:22.185346 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5ad436ed-c0cc-4a85-8379-f44c78c22fd6 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:22.186374 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5ad436ed-c0cc-4a85-8379-f44c78c22fd6 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:22.187273 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5ad436ed-c0cc-4a85-8379-f44c78c22fd6 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:22.187884 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5ad436ed-c0cc-4a85-8379-f44c78c22fd6 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:22.287078 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-5ad436ed-c0cc-4a85-8379-f44c78c22fd6 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] HTTP exception thrown: Instance 7836b504-3cbd-48ca-8fa3-02930a6f27e1 could not be found. Jan 15 02:42:22.287752 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5ad436ed-c0cc-4a85-8379-f44c78c22fd6 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] Returning 404 to user: Instance 7836b504-3cbd-48ca-8fa3-02930a6f27e1 could not be found. {{(pid=94111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:42:22.289681 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5ad436ed-c0cc-4a85-8379-f44c78c22fd6 tempest-VolumesActionsTest-1181529527 tempest-VolumesActionsTest-1181529527] 10.222.0.37 "GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1" status: 404 len: 111 microversion: 2.1 time: 0.124687 Jan 15 02:42:22.290597 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 181/332] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:22 2021] GET /compute/v2.1/servers/7836b504-3cbd-48ca-8fa3-02930a6f27e1 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:42:22.340046 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-5afbc142-0e41-41f5-8e20-81e0e50b34be tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Flavor limits 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 02:42:22.341191 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-5afbc142-0e41-41f5-8e20-81e0e50b34be tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Image limits 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Jan 15 02:42:22.342666 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-5afbc142-0e41-41f5-8e20-81e0e50b34be tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Flavor pref 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 02:42:22.343876 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-5afbc142-0e41-41f5-8e20-81e0e50b34be tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Image pref 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Jan 15 02:42:22.344928 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-5afbc142-0e41-41f5-8e20-81e0e50b34be tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Jan 15 02:42:22.367217 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5afbc142-0e41-41f5-8e20-81e0e50b34be tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:22.367217 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5afbc142-0e41-41f5-8e20-81e0e50b34be tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:22.376438 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5afbc142-0e41-41f5-8e20-81e0e50b34be tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:22.378248 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5afbc142-0e41-41f5-8e20-81e0e50b34be tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:22.430557 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-5afbc142-0e41-41f5-8e20-81e0e50b34be tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Getting quotas for project 021678626dd143d687a9bf2afee638a9. Resources: {'ram', 'instances', 'cores'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:42:22.438552 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-5afbc142-0e41-41f5-8e20-81e0e50b34be tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Getting quotas for user 995863afc2c1475593bef164d921400f and project 021678626dd143d687a9bf2afee638a9. Resources: {'ram', 'instances', 'cores'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:42:22.477955 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-8c4b8b64-f02b-4af1-b1cc-3332da88c0dc tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:22.478264 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5afbc142-0e41-41f5-8e20-81e0e50b34be tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Going to run 1 instances... {{(pid=94112) _provision_instances /opt/stack/nova/nova/compute/api.py:1263}} Jan 15 02:42:22.478946 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8c4b8b64-f02b-4af1-b1cc-3332da88c0dc tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:22.489802 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5afbc142-0e41-41f5-8e20-81e0e50b34be tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1807a1cb-835d-4a56-8751-82ffa40b12c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94112) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1661}} Jan 15 02:42:22.501732 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8c4b8b64-f02b-4af1-b1cc-3332da88c0dc tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:22.503034 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8c4b8b64-f02b-4af1-b1cc-3332da88c0dc tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:22.507721 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8c4b8b64-f02b-4af1-b1cc-3332da88c0dc tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:22.509126 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8c4b8b64-f02b-4af1-b1cc-3332da88c0dc tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:22.712840 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5afbc142-0e41-41f5-8e20-81e0e50b34be tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.890443 Jan 15 02:42:22.714521 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 152/333] 10.222.0.37 () {60 vars in 1137 bytes} [Fri Jan 15 02:42:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 2896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 02:42:22.754732 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e5a1e45c-6896-4d5b-93ed-e2359267efa9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:22.763835 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e5a1e45c-6896-4d5b-93ed-e2359267efa9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:22.810953 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e5a1e45c-6896-4d5b-93ed-e2359267efa9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:22.816914 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e5a1e45c-6896-4d5b-93ed-e2359267efa9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:22.818972 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e5a1e45c-6896-4d5b-93ed-e2359267efa9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:22.821808 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e5a1e45c-6896-4d5b-93ed-e2359267efa9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:23.496384 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-8c4b8b64-f02b-4af1-b1cc-3332da88c0dc tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "DELETE /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6/os-volume_attachments/d9c66074-4f6c-43f1-b924-f2cd6d31a27d" status: 202 len: 0 microversion: 2.1 time: 1.053366 Jan 15 02:42:23.498149 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 182/334] 10.222.0.37 () {58 vars in 1406 bytes} [Fri Jan 15 02:42:22 2021] DELETE /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6/os-volume_attachments/d9c66074-4f6c-43f1-b924-f2cd6d31a27d => generated 0 bytes in 1057 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:42:23.539399 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-960501b4-cb31-4b2f-8d8d-b616508940af tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:23.540109 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-960501b4-cb31-4b2f-8d8d-b616508940af tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:23.738997 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-960501b4-cb31-4b2f-8d8d-b616508940af tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:23.763587 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-960501b4-cb31-4b2f-8d8d-b616508940af tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 200 len: 1218 microversion: 2.1 time: 0.263832 Jan 15 02:42:23.768285 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 183/335] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:23 2021] GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 1218 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:23.799058 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9c07262f-d7b0-41a0-8b3b-5df96672a9f0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb875f13-e2ea-41e6-a714-d42708396ce6"}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:23.809088 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9c07262f-d7b0-41a0-8b3b-5df96672a9f0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:23.828567 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e5a1e45c-6896-4d5b-93ed-e2359267efa9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:23.835420 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9c07262f-d7b0-41a0-8b3b-5df96672a9f0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:23.850145 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9c07262f-d7b0-41a0-8b3b-5df96672a9f0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:23.852188 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9c07262f-d7b0-41a0-8b3b-5df96672a9f0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:23.852636 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9c07262f-d7b0-41a0-8b3b-5df96672a9f0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:23.884966 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e5a1e45c-6896-4d5b-93ed-e2359267efa9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:23.906192 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e5a1e45c-6896-4d5b-93ed-e2359267efa9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:23.911253 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e5a1e45c-6896-4d5b-93ed-e2359267efa9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1754 microversion: 2.20 time: 1.182059 Jan 15 02:42:23.911872 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 153/336] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:42:22 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1754 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:42:24.816185 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-0707dc79-8fcb-4fb3-ae90-0cbb486399df tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:24.817562 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-0707dc79-8fcb-4fb3-ae90-0cbb486399df tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:24.845189 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0707dc79-8fcb-4fb3-ae90-0cbb486399df tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:24.854899 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0707dc79-8fcb-4fb3-ae90-0cbb486399df tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:24.860246 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0707dc79-8fcb-4fb3-ae90-0cbb486399df tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:24.862117 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0707dc79-8fcb-4fb3-ae90-0cbb486399df tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:25.032753 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9c07262f-d7b0-41a0-8b3b-5df96672a9f0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.258505 Jan 15 02:42:25.033540 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 184/337] 10.222.0.37 () {60 vars in 1313 bytes} [Fri Jan 15 02:42:23 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/os-volume_attachments => generated 194 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:42:25.076913 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f153fe42-4380-48c6-ab77-d9c5d59c4891 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:25.077740 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f153fe42-4380-48c6-ab77-d9c5d59c4891 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:25.117237 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f153fe42-4380-48c6-ab77-d9c5d59c4891 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:25.122263 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f153fe42-4380-48c6-ab77-d9c5d59c4891 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:25.123444 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f153fe42-4380-48c6-ab77-d9c5d59c4891 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:25.125447 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f153fe42-4380-48c6-ab77-d9c5d59c4891 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:25.280805 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0707dc79-8fcb-4fb3-ae90-0cbb486399df tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:25.301932 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-0707dc79-8fcb-4fb3-ae90-0cbb486399df tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 200 len: 1270 microversion: 2.1 time: 0.496312 Jan 15 02:42:25.310711 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 154/338] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:24 2021] GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 1270 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:26.335373 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-89f7a0e6-5209-4675-a166-24abac6d1805 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:26.336237 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-89f7a0e6-5209-4675-a166-24abac6d1805 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:26.402466 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-89f7a0e6-5209-4675-a166-24abac6d1805 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:26.406270 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-89f7a0e6-5209-4675-a166-24abac6d1805 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:26.412545 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-89f7a0e6-5209-4675-a166-24abac6d1805 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:26.422119 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-89f7a0e6-5209-4675-a166-24abac6d1805 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:27.263580 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-89f7a0e6-5209-4675-a166-24abac6d1805 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:27.295519 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f153fe42-4380-48c6-ab77-d9c5d59c4891 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:27.301381 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-89f7a0e6-5209-4675-a166-24abac6d1805 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 200 len: 1276 microversion: 2.1 time: 0.975345 Jan 15 02:42:27.305914 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 155/339] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:26 2021] GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 1276 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:27.418892 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f153fe42-4380-48c6-ab77-d9c5d59c4891 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:27.465341 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f153fe42-4380-48c6-ab77-d9c5d59c4891 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:27.468056 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f153fe42-4380-48c6-ab77-d9c5d59c4891 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1810 microversion: 2.20 time: 2.425649 Jan 15 02:42:27.484586 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 185/340] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:42:25 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1810 bytes in 2444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:42:28.354260 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4f88d867-731f-492d-b273-e02a96064e4d tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:28.354940 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4f88d867-731f-492d-b273-e02a96064e4d tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:28.373400 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4f88d867-731f-492d-b273-e02a96064e4d tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:28.376874 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4f88d867-731f-492d-b273-e02a96064e4d tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:28.380163 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4f88d867-731f-492d-b273-e02a96064e4d tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:28.380820 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4f88d867-731f-492d-b273-e02a96064e4d tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:28.512817 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-158ef239-07c3-4723-8d73-16313137db76 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:28.513531 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-158ef239-07c3-4723-8d73-16313137db76 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:28.536844 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-158ef239-07c3-4723-8d73-16313137db76 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:28.546104 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-158ef239-07c3-4723-8d73-16313137db76 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:28.548531 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-158ef239-07c3-4723-8d73-16313137db76 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:28.549986 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-158ef239-07c3-4723-8d73-16313137db76 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:29.376131 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4f88d867-731f-492d-b273-e02a96064e4d tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:29.394506 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4f88d867-731f-492d-b273-e02a96064e4d tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 200 len: 1276 microversion: 2.1 time: 1.059695 Jan 15 02:42:29.396869 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 156/341] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:28 2021] GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 1276 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:29.856872 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-158ef239-07c3-4723-8d73-16313137db76 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:29.900802 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-158ef239-07c3-4723-8d73-16313137db76 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:29.917757 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-158ef239-07c3-4723-8d73-16313137db76 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:29.920054 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-158ef239-07c3-4723-8d73-16313137db76 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1810 microversion: 2.20 time: 1.419159 Jan 15 02:42:29.921241 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 186/342] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:42:28 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1810 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:42:30.435023 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9a88fc8b-603a-4d5e-9ba0-84ed8a31f100 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:30.436001 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9a88fc8b-603a-4d5e-9ba0-84ed8a31f100 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:30.446739 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9a88fc8b-603a-4d5e-9ba0-84ed8a31f100 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:30.447595 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9a88fc8b-603a-4d5e-9ba0-84ed8a31f100 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:30.448712 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9a88fc8b-603a-4d5e-9ba0-84ed8a31f100 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:30.449898 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9a88fc8b-603a-4d5e-9ba0-84ed8a31f100 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:30.951252 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-fbbd7954-d46c-463c-818c-ad1c3149e945 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:30.956690 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-fbbd7954-d46c-463c-818c-ad1c3149e945 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:30.983649 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fbbd7954-d46c-463c-818c-ad1c3149e945 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:30.984430 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fbbd7954-d46c-463c-818c-ad1c3149e945 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:30.986001 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fbbd7954-d46c-463c-818c-ad1c3149e945 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:30.988302 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fbbd7954-d46c-463c-818c-ad1c3149e945 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:31.756806 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-9a88fc8b-603a-4d5e-9ba0-84ed8a31f100 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:31.778630 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9a88fc8b-603a-4d5e-9ba0-84ed8a31f100 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 200 len: 1318 microversion: 2.1 time: 1.366558 Jan 15 02:42:31.793238 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 157/343] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:30 2021] GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 1318 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:32.822268 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b52ce058-7688-46cd-80bc-d3048f371edf tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:32.823676 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b52ce058-7688-46cd-80bc-d3048f371edf tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:32.858749 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b52ce058-7688-46cd-80bc-d3048f371edf tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:32.859284 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b52ce058-7688-46cd-80bc-d3048f371edf tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:32.860182 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b52ce058-7688-46cd-80bc-d3048f371edf tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:32.860689 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b52ce058-7688-46cd-80bc-d3048f371edf tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:33.625043 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-fbbd7954-d46c-463c-818c-ad1c3149e945 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:33.711676 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-fbbd7954-d46c-463c-818c-ad1c3149e945 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:33.755665 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-fbbd7954-d46c-463c-818c-ad1c3149e945 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:33.759649 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-fbbd7954-d46c-463c-818c-ad1c3149e945 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1810 microversion: 2.20 time: 2.819866 Jan 15 02:42:33.767549 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 187/344] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:42:30 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1810 bytes in 2829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:42:34.795868 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e44cabc1-75d3-4ae3-890f-2282b0c5ae61 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:34.796560 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e44cabc1-75d3-4ae3-890f-2282b0c5ae61 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:34.837626 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e44cabc1-75d3-4ae3-890f-2282b0c5ae61 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:34.838901 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e44cabc1-75d3-4ae3-890f-2282b0c5ae61 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:34.840004 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e44cabc1-75d3-4ae3-890f-2282b0c5ae61 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:34.841927 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e44cabc1-75d3-4ae3-890f-2282b0c5ae61 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:35.718157 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b52ce058-7688-46cd-80bc-d3048f371edf tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:35.756683 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b52ce058-7688-46cd-80bc-d3048f371edf tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 200 len: 1318 microversion: 2.1 time: 2.953160 Jan 15 02:42:35.757842 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 158/345] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:32 2021] GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 1318 bytes in 2956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:42:35.833761 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-abd45cc6-8053-4b8a-82e0-488361ec3da3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:35.834601 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-abd45cc6-8053-4b8a-82e0-488361ec3da3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:35.877121 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-abd45cc6-8053-4b8a-82e0-488361ec3da3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:35.890475 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-abd45cc6-8053-4b8a-82e0-488361ec3da3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:35.892366 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-abd45cc6-8053-4b8a-82e0-488361ec3da3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:35.897985 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-abd45cc6-8053-4b8a-82e0-488361ec3da3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:36.334876 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-abd45cc6-8053-4b8a-82e0-488361ec3da3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Going to try to terminate instance {{(pid=94112) delete /opt/stack/nova/nova/compute/api.py:2535}} Jan 15 02:42:36.864591 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-abd45cc6-8053-4b8a-82e0-488361ec3da3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "DELETE /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 204 len: 0 microversion: 2.1 time: 1.103775 Jan 15 02:42:36.868514 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 159/346] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:42:35 2021] DELETE /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 0 bytes in 1107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 02:42:36.898146 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-46a2694f-995c-4f34-9873-af6d7d2c79d6 req-9148cd88-7ab9-4de4-a41d-6d6ae438fd33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c7655c8-a23b-450e-860e-ca0419dfd7b6", "tag": "0700ea1e-d416-4d37-a2d2-b3cb2eca7bfa"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:36.912720 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:42:36.912720 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:42:36.942109 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e44cabc1-75d3-4ae3-890f-2282b0c5ae61 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:36.942434 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-46a2694f-995c-4f34-9873-af6d7d2c79d6 req-9148cd88-7ab9-4de4-a41d-6d6ae438fd33 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:36.942863 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-46a2694f-995c-4f34-9873-af6d7d2c79d6 req-9148cd88-7ab9-4de4-a41d-6d6ae438fd33 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:36.980431 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-46a2694f-995c-4f34-9873-af6d7d2c79d6 req-9148cd88-7ab9-4de4-a41d-6d6ae438fd33 service nova] Creating event network-changed:0700ea1e-d416-4d37-a2d2-b3cb2eca7bfa for instance 3c7655c8-a23b-450e-860e-ca0419dfd7b6 on hv-cinder-76330 Jan 15 02:42:37.003146 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-46a2694f-995c-4f34-9873-af6d7d2c79d6 req-9148cd88-7ab9-4de4-a41d-6d6ae438fd33 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135476 Jan 15 02:42:37.003841 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 160/347] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:42:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:42:37.029345 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-17149c83-2428-42b2-93aa-db408a17acf8 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:37.030954 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-17149c83-2428-42b2-93aa-db408a17acf8 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:37.044257 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e44cabc1-75d3-4ae3-890f-2282b0c5ae61 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:37.063268 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e44cabc1-75d3-4ae3-890f-2282b0c5ae61 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:37.064566 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e44cabc1-75d3-4ae3-890f-2282b0c5ae61 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1810 microversion: 2.20 time: 2.279583 Jan 15 02:42:37.065166 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 188/348] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:42:34 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1810 bytes in 2281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:42:37.075691 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-17149c83-2428-42b2-93aa-db408a17acf8 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:37.076538 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-17149c83-2428-42b2-93aa-db408a17acf8 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:37.077976 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-17149c83-2428-42b2-93aa-db408a17acf8 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:37.078752 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-17149c83-2428-42b2-93aa-db408a17acf8 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:37.092086 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a4cd115e-99c3-40eb-a419-6c94e9f82844 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:37.092769 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a4cd115e-99c3-40eb-a419-6c94e9f82844 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:37.111976 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a4cd115e-99c3-40eb-a419-6c94e9f82844 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:37.112507 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a4cd115e-99c3-40eb-a419-6c94e9f82844 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:37.113448 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a4cd115e-99c3-40eb-a419-6c94e9f82844 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:37.113956 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a4cd115e-99c3-40eb-a419-6c94e9f82844 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:37.707671 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-17149c83-2428-42b2-93aa-db408a17acf8 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:37.735206 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-17149c83-2428-42b2-93aa-db408a17acf8 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 200 len: 1318 microversion: 2.1 time: 0.729454 Jan 15 02:42:37.736336 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 161/349] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:37 2021] GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 1318 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:38.112773 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-fac5e0de-6b8b-4eed-a071-ba7307fb4b32 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:38.116976 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-fac5e0de-6b8b-4eed-a071-ba7307fb4b32 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:38.142862 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fac5e0de-6b8b-4eed-a071-ba7307fb4b32 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:38.143667 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fac5e0de-6b8b-4eed-a071-ba7307fb4b32 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:38.144761 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fac5e0de-6b8b-4eed-a071-ba7307fb4b32 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:38.145468 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fac5e0de-6b8b-4eed-a071-ba7307fb4b32 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:38.567899 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-fac5e0de-6b8b-4eed-a071-ba7307fb4b32 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:38.623160 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a4cd115e-99c3-40eb-a419-6c94e9f82844 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:38.663532 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a4cd115e-99c3-40eb-a419-6c94e9f82844 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1508 microversion: 2.1 time: 1.595857 Jan 15 02:42:38.663886 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 189/350] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:37 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1508 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:38.720140 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-fac5e0de-6b8b-4eed-a071-ba7307fb4b32 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:38.731039 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-fac5e0de-6b8b-4eed-a071-ba7307fb4b32 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:38.733275 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-fac5e0de-6b8b-4eed-a071-ba7307fb4b32 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1810 microversion: 2.20 time: 0.632008 Jan 15 02:42:38.734163 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 162/351] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:42:38 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1810 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:42:38.778208 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-0f8020d8-5198-46ce-a975-3cb04e233d36 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:38.779802 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-0f8020d8-5198-46ce-a975-3cb04e233d36 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:38.792032 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0f8020d8-5198-46ce-a975-3cb04e233d36 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:38.793155 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0f8020d8-5198-46ce-a975-3cb04e233d36 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:38.794452 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0f8020d8-5198-46ce-a975-3cb04e233d36 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:38.794935 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0f8020d8-5198-46ce-a975-3cb04e233d36 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:39.603656 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0f8020d8-5198-46ce-a975-3cb04e233d36 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:39.639884 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-0f8020d8-5198-46ce-a975-3cb04e233d36 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 200 len: 1318 microversion: 2.1 time: 0.886935 Jan 15 02:42:39.665228 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 190/352] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:38 2021] GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 1318 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:39.868848 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-dde7df37-b221-4fff-a16f-612557d8eac2 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:39.870378 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-dde7df37-b221-4fff-a16f-612557d8eac2 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:39.880921 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-22dfcdd6-443d-4495-935f-19732e66b2cb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:39.882095 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-22dfcdd6-443d-4495-935f-19732e66b2cb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:39.889452 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dde7df37-b221-4fff-a16f-612557d8eac2 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:39.890988 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dde7df37-b221-4fff-a16f-612557d8eac2 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:39.891899 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dde7df37-b221-4fff-a16f-612557d8eac2 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:39.892404 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dde7df37-b221-4fff-a16f-612557d8eac2 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:39.908837 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-22dfcdd6-443d-4495-935f-19732e66b2cb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:39.909402 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-22dfcdd6-443d-4495-935f-19732e66b2cb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:39.910263 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-22dfcdd6-443d-4495-935f-19732e66b2cb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:39.910778 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-22dfcdd6-443d-4495-935f-19732e66b2cb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:40.763922 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-dde7df37-b221-4fff-a16f-612557d8eac2 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:40.805661 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-dde7df37-b221-4fff-a16f-612557d8eac2 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1508 microversion: 2.1 time: 1.118135 Jan 15 02:42:40.810582 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 163/353] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:39 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1508 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:40.838780 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3a3eef2d-4cc4-4e75-a7af-a09803fd69fb tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:40.854411 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3a3eef2d-4cc4-4e75-a7af-a09803fd69fb tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:40.887351 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a3eef2d-4cc4-4e75-a7af-a09803fd69fb tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:40.888628 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a3eef2d-4cc4-4e75-a7af-a09803fd69fb tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:40.890880 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a3eef2d-4cc4-4e75-a7af-a09803fd69fb tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:40.892233 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a3eef2d-4cc4-4e75-a7af-a09803fd69fb tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:41.196609 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-22dfcdd6-443d-4495-935f-19732e66b2cb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:41.252450 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-22dfcdd6-443d-4495-935f-19732e66b2cb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:41.260601 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3a3eef2d-4cc4-4e75-a7af-a09803fd69fb tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:41.270185 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-22dfcdd6-443d-4495-935f-19732e66b2cb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:41.271976 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-22dfcdd6-443d-4495-935f-19732e66b2cb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1810 microversion: 2.20 time: 1.518894 Jan 15 02:42:41.278300 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 191/354] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:42:39 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1810 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:42:41.291119 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3a3eef2d-4cc4-4e75-a7af-a09803fd69fb tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 200 len: 1318 microversion: 2.1 time: 0.478413 Jan 15 02:42:41.310873 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 164/355] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:40 2021] GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 1318 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:41.833614 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-db4f0b60-feb2-468a-b93d-e8de5bea6383 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:41.834956 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-db4f0b60-feb2-468a-b93d-e8de5bea6383 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:41.864878 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-db4f0b60-feb2-468a-b93d-e8de5bea6383 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:41.871356 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-db4f0b60-feb2-468a-b93d-e8de5bea6383 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:41.878378 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-db4f0b60-feb2-468a-b93d-e8de5bea6383 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:41.879155 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-db4f0b60-feb2-468a-b93d-e8de5bea6383 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:42.317036 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-43797f18-bc28-4b50-957d-7844101d0d98 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:42.318045 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-43797f18-bc28-4b50-957d-7844101d0d98 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:42.353804 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-43797f18-bc28-4b50-957d-7844101d0d98 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:42.354565 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-43797f18-bc28-4b50-957d-7844101d0d98 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:42.355623 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-43797f18-bc28-4b50-957d-7844101d0d98 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:42.357725 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-43797f18-bc28-4b50-957d-7844101d0d98 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:42.609681 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-db4f0b60-feb2-468a-b93d-e8de5bea6383 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:42.639076 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-db4f0b60-feb2-468a-b93d-e8de5bea6383 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1508 microversion: 2.1 time: 0.818790 Jan 15 02:42:42.643147 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 192/356] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:41 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1508 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:42:42.675556 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6a77d282-e509-46df-b9a8-414063888757 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:42.691133 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6a77d282-e509-46df-b9a8-414063888757 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:42.718822 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6a77d282-e509-46df-b9a8-414063888757 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:42.719638 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6a77d282-e509-46df-b9a8-414063888757 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:42.720704 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6a77d282-e509-46df-b9a8-414063888757 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:42.724338 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6a77d282-e509-46df-b9a8-414063888757 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:43.123736 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-43797f18-bc28-4b50-957d-7844101d0d98 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:43.276092 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-43797f18-bc28-4b50-957d-7844101d0d98 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:43.342756 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-43797f18-bc28-4b50-957d-7844101d0d98 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:43.354476 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-43797f18-bc28-4b50-957d-7844101d0d98 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1810 microversion: 2.20 time: 1.058423 Jan 15 02:42:43.357072 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 165/357] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:42:42 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1810 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:42:43.754348 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-bfb62dbc-904a-4d76-84f5-f1c654d5e60f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:43.762117 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-bfb62dbc-904a-4d76-84f5-f1c654d5e60f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:43.853835 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bfb62dbc-904a-4d76-84f5-f1c654d5e60f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:43.857790 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bfb62dbc-904a-4d76-84f5-f1c654d5e60f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:43.864146 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bfb62dbc-904a-4d76-84f5-f1c654d5e60f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:43.868045 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bfb62dbc-904a-4d76-84f5-f1c654d5e60f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:44.126284 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6a77d282-e509-46df-b9a8-414063888757 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:44.143611 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6a77d282-e509-46df-b9a8-414063888757 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 200 len: 1318 microversion: 2.1 time: 1.497432 Jan 15 02:42:44.147091 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 193/358] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:42 2021] GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 1318 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:44.389912 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-bfb62dbc-904a-4d76-84f5-f1c654d5e60f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:44.399380 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a3a71f73-b9b4-4fb2-877c-4c4d7fab1cd8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:44.402763 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-bfb62dbc-904a-4d76-84f5-f1c654d5e60f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1508 microversion: 2.1 time: 0.743217 Jan 15 02:42:44.413039 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 166/359] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:43 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1508 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:44.415646 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a3a71f73-b9b4-4fb2-877c-4c4d7fab1cd8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:44.425174 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a3a71f73-b9b4-4fb2-877c-4c4d7fab1cd8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:44.425953 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a3a71f73-b9b4-4fb2-877c-4c4d7fab1cd8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:44.427040 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a3a71f73-b9b4-4fb2-877c-4c4d7fab1cd8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:44.428427 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a3a71f73-b9b4-4fb2-877c-4c4d7fab1cd8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:44.706212 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 02:42:44.706522 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: Fri Jan 15 02:42:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa (ip 10.222.0.37) !!! Jan 15 02:42:44.911404 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a3a71f73-b9b4-4fb2-877c-4c4d7fab1cd8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:44.928540 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a3a71f73-b9b4-4fb2-877c-4c4d7fab1cd8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:44.935561 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a3a71f73-b9b4-4fb2-877c-4c4d7fab1cd8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:44.937124 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a3a71f73-b9b4-4fb2-877c-4c4d7fab1cd8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1810 microversion: 2.20 time: 0.550996 Jan 15 02:42:44.937728 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 194/360] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:42:44 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1810 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:42:45.171445 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-313ddcab-8f8a-4256-802b-bc7cdf5c76a4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:45.172135 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-313ddcab-8f8a-4256-802b-bc7cdf5c76a4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:45.186067 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-313ddcab-8f8a-4256-802b-bc7cdf5c76a4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:45.187252 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-313ddcab-8f8a-4256-802b-bc7cdf5c76a4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:45.188156 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-313ddcab-8f8a-4256-802b-bc7cdf5c76a4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:45.188659 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-313ddcab-8f8a-4256-802b-bc7cdf5c76a4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:45.435000 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-55fc0854-67a7-4c88-803e-a76108c3a72a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:45.436702 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-55fc0854-67a7-4c88-803e-a76108c3a72a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:45.459892 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-55fc0854-67a7-4c88-803e-a76108c3a72a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:45.461356 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-55fc0854-67a7-4c88-803e-a76108c3a72a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:45.463200 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-55fc0854-67a7-4c88-803e-a76108c3a72a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:45.464270 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-55fc0854-67a7-4c88-803e-a76108c3a72a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:45.911311 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-313ddcab-8f8a-4256-802b-bc7cdf5c76a4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:45.932200 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-313ddcab-8f8a-4256-802b-bc7cdf5c76a4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 200 len: 1318 microversion: 2.1 time: 0.770772 Jan 15 02:42:45.943273 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 167/361] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:45 2021] GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 1318 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:42:45.971755 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-116fc382-e696-4acf-a9a1-a2c880406bb7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:45.972884 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-116fc382-e696-4acf-a9a1-a2c880406bb7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:45.994869 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-116fc382-e696-4acf-a9a1-a2c880406bb7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:45.995316 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-116fc382-e696-4acf-a9a1-a2c880406bb7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:45.996214 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-116fc382-e696-4acf-a9a1-a2c880406bb7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:45.996716 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-116fc382-e696-4acf-a9a1-a2c880406bb7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:46.442553 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-55fc0854-67a7-4c88-803e-a76108c3a72a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:46.466636 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-55fc0854-67a7-4c88-803e-a76108c3a72a tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1508 microversion: 2.1 time: 1.045893 Jan 15 02:42:46.470573 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 195/362] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:45 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1508 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:42:46.960397 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-8ddfd925-35d2-48f8-b3f6-a9f3d48e82a1 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:46.960739 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8ddfd925-35d2-48f8-b3f6-a9f3d48e82a1 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:47.003891 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8ddfd925-35d2-48f8-b3f6-a9f3d48e82a1 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:47.007701 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8ddfd925-35d2-48f8-b3f6-a9f3d48e82a1 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:47.011109 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8ddfd925-35d2-48f8-b3f6-a9f3d48e82a1 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:47.011638 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8ddfd925-35d2-48f8-b3f6-a9f3d48e82a1 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:47.627979 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-116fc382-e696-4acf-a9a1-a2c880406bb7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:47.741667 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-116fc382-e696-4acf-a9a1-a2c880406bb7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:47.791171 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-116fc382-e696-4acf-a9a1-a2c880406bb7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:47.796267 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-116fc382-e696-4acf-a9a1-a2c880406bb7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1810 microversion: 2.20 time: 1.842515 Jan 15 02:42:47.801999 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 168/363] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:42:45 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1810 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:42:47.832762 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-8fbb703c-2826-4d8d-a4ae-2e47f77ac54d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:47.835221 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8fbb703c-2826-4d8d-a4ae-2e47f77ac54d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:47.860462 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8fbb703c-2826-4d8d-a4ae-2e47f77ac54d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:47.860972 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8fbb703c-2826-4d8d-a4ae-2e47f77ac54d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:47.862032 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8fbb703c-2826-4d8d-a4ae-2e47f77ac54d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:47.862387 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8fbb703c-2826-4d8d-a4ae-2e47f77ac54d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:48.463147 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-8fbb703c-2826-4d8d-a4ae-2e47f77ac54d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:48.492818 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-8fbb703c-2826-4d8d-a4ae-2e47f77ac54d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1508 microversion: 2.1 time: 0.689502 Jan 15 02:42:48.493810 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 169/364] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:47 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1508 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:48.526673 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-8ddfd925-35d2-48f8-b3f6-a9f3d48e82a1 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:48.550355 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-8ddfd925-35d2-48f8-b3f6-a9f3d48e82a1 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 200 len: 1318 microversion: 2.1 time: 1.601651 Jan 15 02:42:48.553059 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 196/365] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:46 2021] GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 1318 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:48.822726 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2e1d1eca-2a56-4490-bdc4-9384ec47cd16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:48.823391 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2e1d1eca-2a56-4490-bdc4-9384ec47cd16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:48.831393 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2e1d1eca-2a56-4490-bdc4-9384ec47cd16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:48.831900 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2e1d1eca-2a56-4490-bdc4-9384ec47cd16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:48.832780 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2e1d1eca-2a56-4490-bdc4-9384ec47cd16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:48.833281 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2e1d1eca-2a56-4490-bdc4-9384ec47cd16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:48.926195 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-238989ab-eb9a-4dc0-97d7-3f8bafad136e tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Action: 'create', calling method: .version_select at 0x7f878e4a8ae8>, body: {"keypair": {"name": "tempest-TestShelveInstance-2069070189"}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:48.959346 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-238989ab-eb9a-4dc0-97d7-3f8bafad136e tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Getting quotas for project 813af52eb922416fbfc79ce6c132a7d2. Resources: {'key_pairs'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:42:48.964373 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-238989ab-eb9a-4dc0-97d7-3f8bafad136e tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Getting quotas for user 6660cbc87b9f42a2b5fdc179d815d734 and project 813af52eb922416fbfc79ce6c132a7d2. Resources: {'key_pairs'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:42:49.113151 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-2e1d1eca-2a56-4490-bdc4-9384ec47cd16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:49.131295 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-2e1d1eca-2a56-4490-bdc4-9384ec47cd16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:49.145374 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-2e1d1eca-2a56-4490-bdc4-9384ec47cd16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:49.148191 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2e1d1eca-2a56-4490-bdc4-9384ec47cd16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1810 microversion: 2.20 time: 0.335106 Jan 15 02:42:49.150040 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 197/366] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:42:48 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1810 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:42:49.221584 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f98bf8f1-8260-4661-aa7c-7e8f27f1f332 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:49.237844 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f98bf8f1-8260-4661-aa7c-7e8f27f1f332 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:49.238443 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f98bf8f1-8260-4661-aa7c-7e8f27f1f332 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:49.260736 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-238989ab-eb9a-4dc0-97d7-3f8bafad136e tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Getting quotas for project 813af52eb922416fbfc79ce6c132a7d2. Resources: {'key_pairs'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:42:49.267047 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-238989ab-eb9a-4dc0-97d7-3f8bafad136e tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Getting quotas for user 6660cbc87b9f42a2b5fdc179d815d734 and project 813af52eb922416fbfc79ce6c132a7d2. Resources: {'key_pairs'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:42:49.295113 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-238989ab-eb9a-4dc0-97d7-3f8bafad136e tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.795835 Jan 15 02:42:49.296323 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 170/367] 10.222.0.37 () {60 vars in 1148 bytes} [Fri Jan 15 02:42:48 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:49.315177 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2ffb227a-390e-45a8-8844-8475545447ee tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Action: 'create', calling method: .version_select at 0x7f878e646268>, body: {"security_group": {"name": "tempest-TestShelveInstance-1904140384", "description": "tempest-TestShelveInstance-1904140384 description"}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:49.329804 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f98bf8f1-8260-4661-aa7c-7e8f27f1f332 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Going to try to stop instance {{(pid=94111) force_stop /opt/stack/nova/nova/compute/api.py:2575}} Jan 15 02:42:49.459128 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f98bf8f1-8260-4661-aa7c-7e8f27f1f332 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 202 len: 0 microversion: 2.1 time: 0.259940 Jan 15 02:42:49.460537 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 198/368] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:42:49 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:42:49.478856 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6d74525f-d27c-47d2-af9a-9ddc7d38749a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:49.479637 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6d74525f-d27c-47d2-af9a-9ddc7d38749a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:49.488763 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6d74525f-d27c-47d2-af9a-9ddc7d38749a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:49.489303 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6d74525f-d27c-47d2-af9a-9ddc7d38749a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:49.490708 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6d74525f-d27c-47d2-af9a-9ddc7d38749a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:49.491209 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6d74525f-d27c-47d2-af9a-9ddc7d38749a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:49.782259 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2ffb227a-390e-45a8-8844-8475545447ee tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.476696 Jan 15 02:42:49.784605 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 171/369] 10.222.0.37 () {60 vars in 1170 bytes} [Fri Jan 15 02:42:49 2021] POST /compute/v2.1/os-security-groups => generated 245 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:42:49.800284 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6d74525f-d27c-47d2-af9a-9ddc7d38749a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:49.813540 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6d74525f-d27c-47d2-af9a-9ddc7d38749a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1725 microversion: 2.1 time: 0.347002 Jan 15 02:42:49.814005 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-44954116-b487-443d-8036-eb2ea0b20212 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:49.814318 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 199/370] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:49 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1725 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:42:49.815837 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-44954116-b487-443d-8036-eb2ea0b20212 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:49.825507 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c95509ec-8ae2-4046-ba8c-2b4873b61a1a tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:49.826186 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c95509ec-8ae2-4046-ba8c-2b4873b61a1a tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:49.835618 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c95509ec-8ae2-4046-ba8c-2b4873b61a1a tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:49.836116 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c95509ec-8ae2-4046-ba8c-2b4873b61a1a tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:49.836981 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c95509ec-8ae2-4046-ba8c-2b4873b61a1a tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:49.837470 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c95509ec-8ae2-4046-ba8c-2b4873b61a1a tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:49.843011 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-44954116-b487-443d-8036-eb2ea0b20212 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:49.843959 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-44954116-b487-443d-8036-eb2ea0b20212 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:49.845879 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-44954116-b487-443d-8036-eb2ea0b20212 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:49.846741 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-44954116-b487-443d-8036-eb2ea0b20212 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:50.140916 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c95509ec-8ae2-4046-ba8c-2b4873b61a1a tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:50.150540 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c95509ec-8ae2-4046-ba8c-2b4873b61a1a tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 200 len: 1318 microversion: 2.1 time: 0.335048 Jan 15 02:42:50.161107 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 200/371] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:49 2021] GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:50.161509 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1098de80-4561-4ba8-8148-0bb130d6b04e tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Action: 'create', calling method: .version_select at 0x7f878fb028c8>, body: {"security_group_rule": {"parent_group_id": "f690da1b-6dd1-4063-be7c-461a7981d18d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:50.295861 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-44954116-b487-443d-8036-eb2ea0b20212 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:50.305918 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-44954116-b487-443d-8036-eb2ea0b20212 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1508 microversion: 2.1 time: 0.519212 Jan 15 02:42:50.306954 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 172/372] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:49 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1508 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:50.334387 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d341f4b7-9355-4ae0-8e81-def4eac93581 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:50.336039 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d341f4b7-9355-4ae0-8e81-def4eac93581 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:50.353157 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d341f4b7-9355-4ae0-8e81-def4eac93581 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:50.354322 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d341f4b7-9355-4ae0-8e81-def4eac93581 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:50.356235 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d341f4b7-9355-4ae0-8e81-def4eac93581 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:50.357368 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d341f4b7-9355-4ae0-8e81-def4eac93581 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:50.785437 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1098de80-4561-4ba8-8148-0bb130d6b04e tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.632595 Jan 15 02:42:50.792297 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 201/373] 10.222.0.37 () {60 vars in 1185 bytes} [Fri Jan 15 02:42:50 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:42:50.807578 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6706f88f-2b00-4f1d-a0b4-51b10cad221f tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Action: 'create', calling method: .version_select at 0x7f878e7721e0>, body: {"security_group_rule": {"parent_group_id": "f690da1b-6dd1-4063-be7c-461a7981d18d", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:50.863925 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d341f4b7-9355-4ae0-8e81-def4eac93581 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:50.881511 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d341f4b7-9355-4ae0-8e81-def4eac93581 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:50.888698 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d341f4b7-9355-4ae0-8e81-def4eac93581 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:50.890044 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d341f4b7-9355-4ae0-8e81-def4eac93581 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1810 microversion: 2.20 time: 0.577753 Jan 15 02:42:50.891006 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 173/374] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:42:50 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1810 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:42:50.903253 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-63754874-6572-44fe-8dbf-cf1fadfa20aa tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:50.903693 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-63754874-6572-44fe-8dbf-cf1fadfa20aa tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:50.912763 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-63754874-6572-44fe-8dbf-cf1fadfa20aa tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:50.913328 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-63754874-6572-44fe-8dbf-cf1fadfa20aa tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:50.914204 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-63754874-6572-44fe-8dbf-cf1fadfa20aa tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:50.914714 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-63754874-6572-44fe-8dbf-cf1fadfa20aa tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:51.473670 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6706f88f-2b00-4f1d-a0b4-51b10cad221f tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.675748 Jan 15 02:42:51.474942 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 202/375] 10.222.0.37 () {60 vars in 1185 bytes} [Fri Jan 15 02:42:50 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:42:51.528278 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d5e1b7ad-21ee-424d-92db-fb570ffc3d5c tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:51.534909 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d5e1b7ad-21ee-424d-92db-fb570ffc3d5c tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:51.577797 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d5e1b7ad-21ee-424d-92db-fb570ffc3d5c tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:51.577797 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d5e1b7ad-21ee-424d-92db-fb570ffc3d5c tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:51.579298 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d5e1b7ad-21ee-424d-92db-fb570ffc3d5c tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:51.580104 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d5e1b7ad-21ee-424d-92db-fb570ffc3d5c tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:51.881900 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-63754874-6572-44fe-8dbf-cf1fadfa20aa tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:51.938333 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-63754874-6572-44fe-8dbf-cf1fadfa20aa tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1725 microversion: 2.1 time: 1.045519 Jan 15 02:42:51.949999 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 174/376] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:50 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1725 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:51.998030 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-90209510-a666-4a1b-a4a5-691fd77a82f0 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:51.999474 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-90209510-a666-4a1b-a4a5-691fd77a82f0 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:52.066200 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-90209510-a666-4a1b-a4a5-691fd77a82f0 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:52.069728 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-90209510-a666-4a1b-a4a5-691fd77a82f0 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:52.077417 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-90209510-a666-4a1b-a4a5-691fd77a82f0 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:52.081952 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-90209510-a666-4a1b-a4a5-691fd77a82f0 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:52.797958 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d5e1b7ad-21ee-424d-92db-fb570ffc3d5c tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:52.832458 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d5e1b7ad-21ee-424d-92db-fb570ffc3d5c tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 200 len: 1318 microversion: 2.1 time: 1.355601 Jan 15 02:42:52.844762 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 203/377] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:51 2021] GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 1318 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:52.857786 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-756cd213-2279-4fb2-a159-a5cf8cdffbbf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:52.858482 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-756cd213-2279-4fb2-a159-a5cf8cdffbbf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:52.878802 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-756cd213-2279-4fb2-a159-a5cf8cdffbbf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:52.879337 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-756cd213-2279-4fb2-a159-a5cf8cdffbbf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:52.880280 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-756cd213-2279-4fb2-a159-a5cf8cdffbbf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:52.884935 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-756cd213-2279-4fb2-a159-a5cf8cdffbbf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:53.656550 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-90209510-a666-4a1b-a4a5-691fd77a82f0 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:53.698587 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-90209510-a666-4a1b-a4a5-691fd77a82f0 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1508 microversion: 2.1 time: 1.744624 Jan 15 02:42:53.707041 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 175/378] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:51 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1508 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:53.754621 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4b304959-5ee7-4e83-8545-3b224d1ed0cc tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:53.756011 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4b304959-5ee7-4e83-8545-3b224d1ed0cc tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:53.789692 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4b304959-5ee7-4e83-8545-3b224d1ed0cc tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:53.790415 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4b304959-5ee7-4e83-8545-3b224d1ed0cc tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:53.791375 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4b304959-5ee7-4e83-8545-3b224d1ed0cc tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:53.791920 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4b304959-5ee7-4e83-8545-3b224d1ed0cc tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:54.035064 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-756cd213-2279-4fb2-a159-a5cf8cdffbbf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:54.195178 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-756cd213-2279-4fb2-a159-a5cf8cdffbbf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:54.226250 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-756cd213-2279-4fb2-a159-a5cf8cdffbbf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:54.228618 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-756cd213-2279-4fb2-a159-a5cf8cdffbbf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1810 microversion: 2.20 time: 1.392966 Jan 15 02:42:54.232701 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 204/379] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:42:52 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1810 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:42:54.285294 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d75effe0-07dd-473e-8fec-f65e3dc9df68 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:54.287731 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d75effe0-07dd-473e-8fec-f65e3dc9df68 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:54.305214 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d75effe0-07dd-473e-8fec-f65e3dc9df68 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:54.306505 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d75effe0-07dd-473e-8fec-f65e3dc9df68 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:54.308536 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d75effe0-07dd-473e-8fec-f65e3dc9df68 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:54.309768 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d75effe0-07dd-473e-8fec-f65e3dc9df68 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:55.376311 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d75effe0-07dd-473e-8fec-f65e3dc9df68 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:55.395383 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d75effe0-07dd-473e-8fec-f65e3dc9df68 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 200 len: 1318 microversion: 2.1 time: 1.160623 Jan 15 02:42:55.396523 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 205/380] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:54 2021] GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 1318 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:55.457663 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-25789339-1387-420f-8cb0-c654a1bd6f3d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:55.459348 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-25789339-1387-420f-8cb0-c654a1bd6f3d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:55.528295 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-25789339-1387-420f-8cb0-c654a1bd6f3d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:55.530265 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-25789339-1387-420f-8cb0-c654a1bd6f3d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:55.531839 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-25789339-1387-420f-8cb0-c654a1bd6f3d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:55.534433 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-25789339-1387-420f-8cb0-c654a1bd6f3d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:55.982728 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4b304959-5ee7-4e83-8545-3b224d1ed0cc tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:56.013442 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4b304959-5ee7-4e83-8545-3b224d1ed0cc tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1725 microversion: 2.1 time: 2.305023 Jan 15 02:42:56.014076 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 176/381] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:53 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1725 bytes in 2307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:56.058281 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-eadc0ccf-42db-40b9-956b-42953043bdbf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:56.059295 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-eadc0ccf-42db-40b9-956b-42953043bdbf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:56.092357 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eadc0ccf-42db-40b9-956b-42953043bdbf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:56.092928 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eadc0ccf-42db-40b9-956b-42953043bdbf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:56.093902 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eadc0ccf-42db-40b9-956b-42953043bdbf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:56.094404 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eadc0ccf-42db-40b9-956b-42953043bdbf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:56.316012 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-25789339-1387-420f-8cb0-c654a1bd6f3d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:56.346469 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-25789339-1387-420f-8cb0-c654a1bd6f3d tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1508 microversion: 2.1 time: 0.926867 Jan 15 02:42:56.352021 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 206/382] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:55 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1508 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:56.421228 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ed5b3f79-d591-442e-8e06-37367dab0de4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:56.426300 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ed5b3f79-d591-442e-8e06-37367dab0de4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:56.446862 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ed5b3f79-d591-442e-8e06-37367dab0de4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:56.447681 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ed5b3f79-d591-442e-8e06-37367dab0de4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:56.450236 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ed5b3f79-d591-442e-8e06-37367dab0de4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:56.452577 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ed5b3f79-d591-442e-8e06-37367dab0de4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:57.382688 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-ed5b3f79-d591-442e-8e06-37367dab0de4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:57.423763 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ed5b3f79-d591-442e-8e06-37367dab0de4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 200 len: 1318 microversion: 2.1 time: 1.012214 Jan 15 02:42:57.430112 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 207/383] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:56 2021] GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 1318 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:57.499350 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2bc470a0-26b5-46f1-91df-5ecbf60b761f tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:57.500994 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2bc470a0-26b5-46f1-91df-5ecbf60b761f tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:57.521679 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2bc470a0-26b5-46f1-91df-5ecbf60b761f tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:57.523340 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2bc470a0-26b5-46f1-91df-5ecbf60b761f tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:57.525245 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2bc470a0-26b5-46f1-91df-5ecbf60b761f tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:57.526488 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2bc470a0-26b5-46f1-91df-5ecbf60b761f tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:58.606484 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-eadc0ccf-42db-40b9-956b-42953043bdbf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:58.621725 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-2bc470a0-26b5-46f1-91df-5ecbf60b761f tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:58.699356 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2bc470a0-26b5-46f1-91df-5ecbf60b761f tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1725 microversion: 2.1 time: 1.244719 Jan 15 02:42:58.700486 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 208/384] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:57 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1725 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:58.716938 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-eadc0ccf-42db-40b9-956b-42953043bdbf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:58.798827 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-930c3d29-aade-4589-8c9a-6c3f2881c1b1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:58.799813 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-eadc0ccf-42db-40b9-956b-42953043bdbf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:58.801128 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-930c3d29-aade-4589-8c9a-6c3f2881c1b1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:58.804839 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-eadc0ccf-42db-40b9-956b-42953043bdbf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1810 microversion: 2.20 time: 2.789140 Jan 15 02:42:58.815897 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 177/385] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:42:56 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1810 bytes in 2801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:42:58.850359 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-930c3d29-aade-4589-8c9a-6c3f2881c1b1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:58.857388 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-930c3d29-aade-4589-8c9a-6c3f2881c1b1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:58.859326 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-930c3d29-aade-4589-8c9a-6c3f2881c1b1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:58.860418 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-930c3d29-aade-4589-8c9a-6c3f2881c1b1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:58.861081 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-4ab93058-4f73-4417-ac53-7c8d4a2d97bd req-f2e3e9e9-d114-458d-a406-eb66f9c25cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c7655c8-a23b-450e-860e-ca0419dfd7b6", "name": "network-vif-plugged", "status": "completed", "tag": "0700ea1e-d416-4d37-a2d2-b3cb2eca7bfa"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:42:58.903119 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:42:58.903119 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:42:58.939269 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-4ab93058-4f73-4417-ac53-7c8d4a2d97bd req-f2e3e9e9-d114-458d-a406-eb66f9c25cf3 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:58.959070 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-4ab93058-4f73-4417-ac53-7c8d4a2d97bd req-f2e3e9e9-d114-458d-a406-eb66f9c25cf3 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:59.021336 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-4ab93058-4f73-4417-ac53-7c8d4a2d97bd req-f2e3e9e9-d114-458d-a406-eb66f9c25cf3 service nova] Creating event network-vif-plugged:0700ea1e-d416-4d37-a2d2-b3cb2eca7bfa for instance 3c7655c8-a23b-450e-860e-ca0419dfd7b6 on hv-cinder-76330 Jan 15 02:42:59.038024 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-4ab93058-4f73-4417-ac53-7c8d4a2d97bd req-f2e3e9e9-d114-458d-a406-eb66f9c25cf3 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218667 Jan 15 02:42:59.040082 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 178/386] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:42:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:42:59.079655 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3275e362-a7ae-4362-89bb-f05044eca745 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:59.083566 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3275e362-a7ae-4362-89bb-f05044eca745 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:59.113383 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3275e362-a7ae-4362-89bb-f05044eca745 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:59.129861 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3275e362-a7ae-4362-89bb-f05044eca745 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:59.134198 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3275e362-a7ae-4362-89bb-f05044eca745 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:59.140923 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3275e362-a7ae-4362-89bb-f05044eca745 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:59.241365 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-930c3d29-aade-4589-8c9a-6c3f2881c1b1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:42:59.271524 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-930c3d29-aade-4589-8c9a-6c3f2881c1b1 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1466 microversion: 2.1 time: 0.550622 Jan 15 02:42:59.272520 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 209/387] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:58 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1466 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:42:59.739705 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a64eab4e-51ac-4978-a83b-b4c6f518ab96 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:42:59.740476 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a64eab4e-51ac-4978-a83b-b4c6f518ab96 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:42:59.779466 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a64eab4e-51ac-4978-a83b-b4c6f518ab96 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:59.779962 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a64eab4e-51ac-4978-a83b-b4c6f518ab96 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:42:59.780991 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a64eab4e-51ac-4978-a83b-b4c6f518ab96 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:42:59.781543 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a64eab4e-51ac-4978-a83b-b4c6f518ab96 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:00.196809 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3275e362-a7ae-4362-89bb-f05044eca745 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:00.227572 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3275e362-a7ae-4362-89bb-f05044eca745 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 200 len: 1318 microversion: 2.1 time: 1.185012 Jan 15 02:43:00.239072 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 179/388] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:59 2021] GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 1318 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:00.274538 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-789a1a46-d2f1-4025-87d3-0825b8be815e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:00.279041 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-789a1a46-d2f1-4025-87d3-0825b8be815e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:00.298708 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-789a1a46-d2f1-4025-87d3-0825b8be815e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:00.299364 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-789a1a46-d2f1-4025-87d3-0825b8be815e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:00.300297 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-789a1a46-d2f1-4025-87d3-0825b8be815e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:00.300838 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-789a1a46-d2f1-4025-87d3-0825b8be815e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:00.318489 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a64eab4e-51ac-4978-a83b-b4c6f518ab96 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:00.336893 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a64eab4e-51ac-4978-a83b-b4c6f518ab96 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1725 microversion: 2.1 time: 0.608072 Jan 15 02:43:00.341252 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 210/389] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:42:59 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1725 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:43:00.354777 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-24c54a03-539b-4d18-accb-727ff78574ab req-c63bfe2f-7c3c-4b89-9ce1-63aa48cc5d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6057534-a522-4ba4-ac63-0082adffe0fe", "name": "network-vif-deleted", "tag": "19815834-163a-484c-af01-9e39e7f652c9"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:43:00.363745 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:43:00.363745 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:43:00.376598 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-24c54a03-539b-4d18-accb-727ff78574ab req-c63bfe2f-7c3c-4b89-9ce1-63aa48cc5d52 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:00.381372 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-24c54a03-539b-4d18-accb-727ff78574ab req-c63bfe2f-7c3c-4b89-9ce1-63aa48cc5d52 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:00.407554 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-24c54a03-539b-4d18-accb-727ff78574ab req-c63bfe2f-7c3c-4b89-9ce1-63aa48cc5d52 service nova] Creating event network-vif-deleted:19815834-163a-484c-af01-9e39e7f652c9 for instance f6057534-a522-4ba4-ac63-0082adffe0fe on hv-cinder-76330 Jan 15 02:43:00.417759 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-24c54a03-539b-4d18-accb-727ff78574ab req-c63bfe2f-7c3c-4b89-9ce1-63aa48cc5d52 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074335 Jan 15 02:43:00.418813 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 211/390] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:43:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:43:00.433988 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1c7d2a70-aa35-4876-a7c0-ace091c7eb3f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:00.435542 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1c7d2a70-aa35-4876-a7c0-ace091c7eb3f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:00.447533 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1c7d2a70-aa35-4876-a7c0-ace091c7eb3f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:00.448304 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1c7d2a70-aa35-4876-a7c0-ace091c7eb3f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:00.455936 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1c7d2a70-aa35-4876-a7c0-ace091c7eb3f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:00.456790 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1c7d2a70-aa35-4876-a7c0-ace091c7eb3f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:00.619151 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1c7d2a70-aa35-4876-a7c0-ace091c7eb3f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:00.619723 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1c7d2a70-aa35-4876-a7c0-ace091c7eb3f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:00.620495 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.objects.instance [None req-1c7d2a70-aa35-4876-a7c0-ace091c7eb3f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lazy-loading 'fault' on Instance uuid f6057534-a522-4ba4-ac63-0082adffe0fe {{(pid=94111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Jan 15 02:43:00.829861 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-789a1a46-d2f1-4025-87d3-0825b8be815e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:00.852636 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-789a1a46-d2f1-4025-87d3-0825b8be815e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:00.862188 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-789a1a46-d2f1-4025-87d3-0825b8be815e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:00.863787 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-789a1a46-d2f1-4025-87d3-0825b8be815e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1810 microversion: 2.20 time: 0.614372 Jan 15 02:43:00.865966 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 180/391] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:43:00 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1810 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:43:00.870140 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1c7d2a70-aa35-4876-a7c0-ace091c7eb3f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:00.905198 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1c7d2a70-aa35-4876-a7c0-ace091c7eb3f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 200 len: 1312 microversion: 2.1 time: 0.484413 Jan 15 02:43:00.906670 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 212/392] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:00 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 1312 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:01.295790 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2f2ba6dd-f50b-4d06-9f52-46661119dfc3 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:01.298619 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2f2ba6dd-f50b-4d06-9f52-46661119dfc3 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:01.344038 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2f2ba6dd-f50b-4d06-9f52-46661119dfc3 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:01.347585 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2f2ba6dd-f50b-4d06-9f52-46661119dfc3 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:01.350308 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2f2ba6dd-f50b-4d06-9f52-46661119dfc3 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:01.356343 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2f2ba6dd-f50b-4d06-9f52-46661119dfc3 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:01.372529 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1490c4ec-6638-4622-a557-43c26dd83bc7 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:01.373309 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1490c4ec-6638-4622-a557-43c26dd83bc7 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:01.400343 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1490c4ec-6638-4622-a557-43c26dd83bc7 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:01.401232 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1490c4ec-6638-4622-a557-43c26dd83bc7 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:01.409477 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1490c4ec-6638-4622-a557-43c26dd83bc7 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:01.410160 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1490c4ec-6638-4622-a557-43c26dd83bc7 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:02.111060 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1490c4ec-6638-4622-a557-43c26dd83bc7 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:02.137507 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1490c4ec-6638-4622-a557-43c26dd83bc7 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1725 microversion: 2.1 time: 0.781939 Jan 15 02:43:02.142940 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 213/393] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:01 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1725 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:02.165995 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3d9a00fa-38c6-46e2-8dfc-efd21aab5dfa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:02.166954 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3d9a00fa-38c6-46e2-8dfc-efd21aab5dfa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:02.176410 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3d9a00fa-38c6-46e2-8dfc-efd21aab5dfa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:02.178077 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3d9a00fa-38c6-46e2-8dfc-efd21aab5dfa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:02.179240 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3d9a00fa-38c6-46e2-8dfc-efd21aab5dfa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:02.179948 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3d9a00fa-38c6-46e2-8dfc-efd21aab5dfa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:02.333833 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-2f2ba6dd-f50b-4d06-9f52-46661119dfc3 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:02.370822 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2f2ba6dd-f50b-4d06-9f52-46661119dfc3 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 200 len: 1318 microversion: 2.1 time: 1.116163 Jan 15 02:43:02.374508 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 181/394] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:01 2021] GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 1318 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:02.413201 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7f53b942-0b4b-4ef8-b82f-c49fd49dd3bb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:02.413878 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-7f53b942-0b4b-4ef8-b82f-c49fd49dd3bb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: f6057534-a522-4ba4-ac63-0082adffe0fe] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:02.429387 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7f53b942-0b4b-4ef8-b82f-c49fd49dd3bb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:02.429955 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7f53b942-0b4b-4ef8-b82f-c49fd49dd3bb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:02.430752 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7f53b942-0b4b-4ef8-b82f-c49fd49dd3bb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:02.431250 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7f53b942-0b4b-4ef8-b82f-c49fd49dd3bb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:02.546742 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3d9a00fa-38c6-46e2-8dfc-efd21aab5dfa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:02.569382 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-7f53b942-0b4b-4ef8-b82f-c49fd49dd3bb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] HTTP exception thrown: Instance f6057534-a522-4ba4-ac63-0082adffe0fe could not be found. Jan 15 02:43:02.573424 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7f53b942-0b4b-4ef8-b82f-c49fd49dd3bb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Returning 404 to user: Instance f6057534-a522-4ba4-ac63-0082adffe0fe could not be found. {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:43:02.574636 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-7f53b942-0b4b-4ef8-b82f-c49fd49dd3bb tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe" status: 404 len: 111 microversion: 2.1 time: 0.176109 Jan 15 02:43:02.581141 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 182/395] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:02 2021] GET /compute/v2.1/servers/f6057534-a522-4ba4-ac63-0082adffe0fe => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:43:02.593238 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3d9a00fa-38c6-46e2-8dfc-efd21aab5dfa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:02.599308 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-053a9074-7f3b-4950-bfa9-abcafc6413a3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:02.600380 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-053a9074-7f3b-4950-bfa9-abcafc6413a3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:02.608478 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3d9a00fa-38c6-46e2-8dfc-efd21aab5dfa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:02.610797 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3d9a00fa-38c6-46e2-8dfc-efd21aab5dfa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1810 microversion: 2.20 time: 0.466056 Jan 15 02:43:02.611445 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-053a9074-7f3b-4950-bfa9-abcafc6413a3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:02.612235 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 214/396] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:43:02 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1810 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:43:02.612394 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-053a9074-7f3b-4950-bfa9-abcafc6413a3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:02.613641 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-053a9074-7f3b-4950-bfa9-abcafc6413a3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:02.614110 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-053a9074-7f3b-4950-bfa9-abcafc6413a3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:02.759849 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-053a9074-7f3b-4950-bfa9-abcafc6413a3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Going to try to terminate instance {{(pid=94112) delete /opt/stack/nova/nova/compute/api.py:2535}} Jan 15 02:43:02.997634 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-053a9074-7f3b-4950-bfa9-abcafc6413a3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "DELETE /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 204 len: 0 microversion: 2.1 time: 0.408916 Jan 15 02:43:03.000463 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 183/397] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:43:02 2021] DELETE /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 02:43:03.016928 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e9b4beef-7149-4e98-9286-b55c5cafff50 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:03.017648 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e9b4beef-7149-4e98-9286-b55c5cafff50 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:03.038772 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e9b4beef-7149-4e98-9286-b55c5cafff50 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:03.039373 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e9b4beef-7149-4e98-9286-b55c5cafff50 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:03.040308 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e9b4beef-7149-4e98-9286-b55c5cafff50 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:03.040878 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e9b4beef-7149-4e98-9286-b55c5cafff50 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:03.196429 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d93b3df8-a29d-4538-97f9-e2d0465668fe tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:03.197507 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d93b3df8-a29d-4538-97f9-e2d0465668fe tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:03.207248 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d93b3df8-a29d-4538-97f9-e2d0465668fe tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:03.207768 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d93b3df8-a29d-4538-97f9-e2d0465668fe tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:03.209982 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d93b3df8-a29d-4538-97f9-e2d0465668fe tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:03.210311 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d93b3df8-a29d-4538-97f9-e2d0465668fe tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:03.521345 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e9b4beef-7149-4e98-9286-b55c5cafff50 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:03.534328 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e9b4beef-7149-4e98-9286-b55c5cafff50 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1522 microversion: 2.1 time: 0.527100 Jan 15 02:43:03.535935 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 215/398] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:03 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1522 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:03.561859 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1d54c2ea-56e9-4f2f-bb04-dfa800fb2020 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:03.563367 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1d54c2ea-56e9-4f2f-bb04-dfa800fb2020 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:03.590845 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1d54c2ea-56e9-4f2f-bb04-dfa800fb2020 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:03.591898 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1d54c2ea-56e9-4f2f-bb04-dfa800fb2020 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:03.593696 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1d54c2ea-56e9-4f2f-bb04-dfa800fb2020 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:03.594816 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1d54c2ea-56e9-4f2f-bb04-dfa800fb2020 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:03.815373 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d93b3df8-a29d-4538-97f9-e2d0465668fe tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:03.836363 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d93b3df8-a29d-4538-97f9-e2d0465668fe tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1725 microversion: 2.1 time: 0.663577 Jan 15 02:43:03.837687 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 184/399] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:03 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1725 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:43:03.856203 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3a974d6b-6d10-4421-ad4d-5475ee9433d9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:03.857219 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3a974d6b-6d10-4421-ad4d-5475ee9433d9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:03.870999 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a974d6b-6d10-4421-ad4d-5475ee9433d9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:03.871931 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a974d6b-6d10-4421-ad4d-5475ee9433d9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:03.873497 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a974d6b-6d10-4421-ad4d-5475ee9433d9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:03.874594 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a974d6b-6d10-4421-ad4d-5475ee9433d9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:03.986985 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1d54c2ea-56e9-4f2f-bb04-dfa800fb2020 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:04.001574 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1d54c2ea-56e9-4f2f-bb04-dfa800fb2020 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 200 len: 1507 microversion: 2.1 time: 0.462090 Jan 15 02:43:04.002679 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 216/400] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:03 2021] GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 1507 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:04.390329 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3a974d6b-6d10-4421-ad4d-5475ee9433d9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:04.423995 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3a974d6b-6d10-4421-ad4d-5475ee9433d9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:04.441956 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3a974d6b-6d10-4421-ad4d-5475ee9433d9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:04.444628 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3a974d6b-6d10-4421-ad4d-5475ee9433d9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1810 microversion: 2.20 time: 0.604944 Jan 15 02:43:04.457749 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 185/401] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:43:03 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1810 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:43:04.577887 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-06eeac49-230a-471b-abc2-689055486760 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:04.578910 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-06eeac49-230a-471b-abc2-689055486760 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:04.588784 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-06eeac49-230a-471b-abc2-689055486760 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:04.589824 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-06eeac49-230a-471b-abc2-689055486760 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:04.590986 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-06eeac49-230a-471b-abc2-689055486760 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:04.591709 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-06eeac49-230a-471b-abc2-689055486760 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:04.863935 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7068e750-b8a8-4779-91a8-883ce9f7f264 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:04.865887 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-7068e750-b8a8-4779-91a8-883ce9f7f264 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:04.876158 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7068e750-b8a8-4779-91a8-883ce9f7f264 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:04.877651 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7068e750-b8a8-4779-91a8-883ce9f7f264 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:04.878962 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7068e750-b8a8-4779-91a8-883ce9f7f264 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:04.879912 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7068e750-b8a8-4779-91a8-883ce9f7f264 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:04.966140 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-06eeac49-230a-471b-abc2-689055486760 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:04.990595 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-06eeac49-230a-471b-abc2-689055486760 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1522 microversion: 2.1 time: 0.422886 Jan 15 02:43:04.991564 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 217/402] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:04 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:05.159391 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-543d2603-6021-4b04-8868-8ebda90e8412 req-d0bcaed5-78db-47d6-8164-bc0b160d2430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a86e56-4ee0-4098-98bb-7deac49ba1aa", "name": "network-vif-plugged", "status": "completed", "tag": "a3bc182a-ab0e-4f1a-9e0f-958740ed4222"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:43:05.175303 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:43:05.175303 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:43:05.186071 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-543d2603-6021-4b04-8868-8ebda90e8412 req-d0bcaed5-78db-47d6-8164-bc0b160d2430 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:05.186566 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-543d2603-6021-4b04-8868-8ebda90e8412 req-d0bcaed5-78db-47d6-8164-bc0b160d2430 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:05.207200 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-543d2603-6021-4b04-8868-8ebda90e8412 req-d0bcaed5-78db-47d6-8164-bc0b160d2430 service nova] Creating event network-vif-plugged:a3bc182a-ab0e-4f1a-9e0f-958740ed4222 for instance a8a86e56-4ee0-4098-98bb-7deac49ba1aa on hv-cinder-76330 Jan 15 02:43:05.216955 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-543d2603-6021-4b04-8868-8ebda90e8412 req-d0bcaed5-78db-47d6-8164-bc0b160d2430 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071588 Jan 15 02:43:05.217705 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 218/403] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:43:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:43:05.265851 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-7068e750-b8a8-4779-91a8-883ce9f7f264 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:05.299355 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-7068e750-b8a8-4779-91a8-883ce9f7f264 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1725 microversion: 2.1 time: 0.445714 Jan 15 02:43:05.325284 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 186/404] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:04 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1725 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:05.523124 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e387e2b9-33a4-4731-8b17-c532122bb9c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:05.523958 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e387e2b9-33a4-4731-8b17-c532122bb9c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:05.537931 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e387e2b9-33a4-4731-8b17-c532122bb9c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:05.538552 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e387e2b9-33a4-4731-8b17-c532122bb9c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:05.539566 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e387e2b9-33a4-4731-8b17-c532122bb9c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:05.540118 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e387e2b9-33a4-4731-8b17-c532122bb9c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:05.895138 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e387e2b9-33a4-4731-8b17-c532122bb9c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:05.914256 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e387e2b9-33a4-4731-8b17-c532122bb9c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:05.922697 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e387e2b9-33a4-4731-8b17-c532122bb9c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:05.924113 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e387e2b9-33a4-4731-8b17-c532122bb9c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1810 microversion: 2.20 time: 0.451234 Jan 15 02:43:05.924845 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 219/405] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:43:05 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1810 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:43:06.027980 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9e0174e3-8314-4630-b36b-f597a6b8f4fd tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:06.029695 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9e0174e3-8314-4630-b36b-f597a6b8f4fd tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:06.046026 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9e0174e3-8314-4630-b36b-f597a6b8f4fd tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:06.046973 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9e0174e3-8314-4630-b36b-f597a6b8f4fd tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:06.048531 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9e0174e3-8314-4630-b36b-f597a6b8f4fd tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:06.049475 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9e0174e3-8314-4630-b36b-f597a6b8f4fd tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:06.343273 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c65249fd-11c9-49e9-8350-6a75c00eea05 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:06.343273 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c65249fd-11c9-49e9-8350-6a75c00eea05 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:06.353538 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c65249fd-11c9-49e9-8350-6a75c00eea05 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:06.354627 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c65249fd-11c9-49e9-8350-6a75c00eea05 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:06.355937 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c65249fd-11c9-49e9-8350-6a75c00eea05 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:06.356263 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c65249fd-11c9-49e9-8350-6a75c00eea05 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:06.612993 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-9e0174e3-8314-4630-b36b-f597a6b8f4fd tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:06.623475 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9e0174e3-8314-4630-b36b-f597a6b8f4fd tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1522 microversion: 2.1 time: 0.616643 Jan 15 02:43:06.624187 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 187/406] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:06 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1522 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:06.780510 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c65249fd-11c9-49e9-8350-6a75c00eea05 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:06.793052 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c65249fd-11c9-49e9-8350-6a75c00eea05 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1725 microversion: 2.1 time: 0.462279 Jan 15 02:43:06.793987 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 220/407] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:06 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1725 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:06.960558 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-970592d1-1830-4b82-8c4e-6a351f0242c9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:06.961301 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-970592d1-1830-4b82-8c4e-6a351f0242c9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:06.970209 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-970592d1-1830-4b82-8c4e-6a351f0242c9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:06.971225 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-970592d1-1830-4b82-8c4e-6a351f0242c9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:06.972421 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-970592d1-1830-4b82-8c4e-6a351f0242c9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:06.973237 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-970592d1-1830-4b82-8c4e-6a351f0242c9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:07.251659 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-970592d1-1830-4b82-8c4e-6a351f0242c9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:07.272787 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-970592d1-1830-4b82-8c4e-6a351f0242c9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:07.280457 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-970592d1-1830-4b82-8c4e-6a351f0242c9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:07.282188 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-970592d1-1830-4b82-8c4e-6a351f0242c9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1810 microversion: 2.20 time: 0.332278 Jan 15 02:43:07.283037 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 188/408] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:43:06 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1810 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:43:07.669528 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-009d71a7-952d-4a28-904c-e4c8159563ab tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:07.670774 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-009d71a7-952d-4a28-904c-e4c8159563ab tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:07.682173 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-009d71a7-952d-4a28-904c-e4c8159563ab tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:07.683009 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-009d71a7-952d-4a28-904c-e4c8159563ab tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:07.683908 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-009d71a7-952d-4a28-904c-e4c8159563ab tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:07.684548 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-009d71a7-952d-4a28-904c-e4c8159563ab tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:07.867432 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4287da15-2b2a-42ff-852d-cf82234ef434 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:07.869106 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4287da15-2b2a-42ff-852d-cf82234ef434 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:07.913660 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4287da15-2b2a-42ff-852d-cf82234ef434 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:07.915018 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4287da15-2b2a-42ff-852d-cf82234ef434 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:07.916910 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4287da15-2b2a-42ff-852d-cf82234ef434 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:07.918130 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4287da15-2b2a-42ff-852d-cf82234ef434 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:08.084630 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-009d71a7-952d-4a28-904c-e4c8159563ab tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:08.120676 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-009d71a7-952d-4a28-904c-e4c8159563ab tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1522 microversion: 2.1 time: 0.469744 Jan 15 02:43:08.123026 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 221/409] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:07 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1522 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:08.339578 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-399e86e3-bf09-46e8-8cc8-c3c0c7c37caf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:08.341117 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-399e86e3-bf09-46e8-8cc8-c3c0c7c37caf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:08.356919 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-399e86e3-bf09-46e8-8cc8-c3c0c7c37caf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:08.357882 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-399e86e3-bf09-46e8-8cc8-c3c0c7c37caf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:08.358907 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-399e86e3-bf09-46e8-8cc8-c3c0c7c37caf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:08.359752 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-399e86e3-bf09-46e8-8cc8-c3c0c7c37caf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:08.409156 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4287da15-2b2a-42ff-852d-cf82234ef434 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:08.422192 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4287da15-2b2a-42ff-852d-cf82234ef434 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1725 microversion: 2.1 time: 0.612653 Jan 15 02:43:08.423418 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 189/410] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:07 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1725 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:43:08.840025 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-399e86e3-bf09-46e8-8cc8-c3c0c7c37caf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:08.877636 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-399e86e3-bf09-46e8-8cc8-c3c0c7c37caf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:08.894692 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-399e86e3-bf09-46e8-8cc8-c3c0c7c37caf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:08.898259 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-399e86e3-bf09-46e8-8cc8-c3c0c7c37caf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1810 microversion: 2.20 time: 0.585039 Jan 15 02:43:08.899326 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 222/411] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:43:08 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1810 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:43:09.163786 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5e1c5204-6cec-41ad-80f5-b36b5834d1e3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:09.164966 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5e1c5204-6cec-41ad-80f5-b36b5834d1e3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:09.174215 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5e1c5204-6cec-41ad-80f5-b36b5834d1e3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:09.174829 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5e1c5204-6cec-41ad-80f5-b36b5834d1e3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:09.175941 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5e1c5204-6cec-41ad-80f5-b36b5834d1e3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:09.176650 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5e1c5204-6cec-41ad-80f5-b36b5834d1e3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:09.464893 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-5e1c5204-6cec-41ad-80f5-b36b5834d1e3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:09.474802 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5e1c5204-6cec-41ad-80f5-b36b5834d1e3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1522 microversion: 2.1 time: 0.327115 Jan 15 02:43:09.475825 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 190/412] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:09 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:43:09.480840 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4d1df8cf-511a-4080-9ce2-1fd6ee7cfc8b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:09.483185 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4d1df8cf-511a-4080-9ce2-1fd6ee7cfc8b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:09.501752 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4d1df8cf-511a-4080-9ce2-1fd6ee7cfc8b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:09.502760 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4d1df8cf-511a-4080-9ce2-1fd6ee7cfc8b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:09.504371 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4d1df8cf-511a-4080-9ce2-1fd6ee7cfc8b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:09.506956 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4d1df8cf-511a-4080-9ce2-1fd6ee7cfc8b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:09.885771 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4d1df8cf-511a-4080-9ce2-1fd6ee7cfc8b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:09.907315 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4d1df8cf-511a-4080-9ce2-1fd6ee7cfc8b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1702 microversion: 2.1 time: 0.459103 Jan 15 02:43:09.921063 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 223/413] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:09 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1702 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:09.947810 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a90ca194-b6b7-4931-8db3-7a351377929c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:09.948567 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a90ca194-b6b7-4931-8db3-7a351377929c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:09.952599 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6f145ab0-03d3-49b3-94ae-0a6deedb010c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:43:09.957622 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a90ca194-b6b7-4931-8db3-7a351377929c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:09.958377 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a90ca194-b6b7-4931-8db3-7a351377929c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:09.959476 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a90ca194-b6b7-4931-8db3-7a351377929c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:09.960295 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a90ca194-b6b7-4931-8db3-7a351377929c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:09.962257 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6f145ab0-03d3-49b3-94ae-0a6deedb010c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:09.962778 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6f145ab0-03d3-49b3-94ae-0a6deedb010c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:10.059736 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6f145ab0-03d3-49b3-94ae-0a6deedb010c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Going to try to start instance {{(pid=94111) start /opt/stack/nova/nova/compute/api.py:2598}} Jan 15 02:43:10.232642 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6f145ab0-03d3-49b3-94ae-0a6deedb010c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 202 len: 0 microversion: 2.1 time: 0.294538 Jan 15 02:43:10.233769 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 224/414] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:43:09 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:43:10.267468 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6934559f-0972-4d9c-bc8c-3c5b1ee72f63 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:10.268677 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6934559f-0972-4d9c-bc8c-3c5b1ee72f63 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:10.278697 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6934559f-0972-4d9c-bc8c-3c5b1ee72f63 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:10.279613 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6934559f-0972-4d9c-bc8c-3c5b1ee72f63 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:10.280716 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6934559f-0972-4d9c-bc8c-3c5b1ee72f63 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:10.281509 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6934559f-0972-4d9c-bc8c-3c5b1ee72f63 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:10.541178 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a90ca194-b6b7-4931-8db3-7a351377929c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:10.574754 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a90ca194-b6b7-4931-8db3-7a351377929c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:10.587407 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a90ca194-b6b7-4931-8db3-7a351377929c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:10.590268 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a90ca194-b6b7-4931-8db3-7a351377929c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1810 microversion: 2.20 time: 0.656333 Jan 15 02:43:10.591305 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 191/415] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:43:09 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1810 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:43:10.614696 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6934559f-0972-4d9c-bc8c-3c5b1ee72f63 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:10.650299 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c894050d-1f32-41d0-a5f2-7a66b122d7f3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:10.651013 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c894050d-1f32-41d0-a5f2-7a66b122d7f3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:10.659029 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6934559f-0972-4d9c-bc8c-3c5b1ee72f63 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1711 microversion: 2.1 time: 0.406576 Jan 15 02:43:10.662646 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 225/416] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:10 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1711 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:10.672315 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c894050d-1f32-41d0-a5f2-7a66b122d7f3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:10.672852 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c894050d-1f32-41d0-a5f2-7a66b122d7f3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:10.673805 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c894050d-1f32-41d0-a5f2-7a66b122d7f3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:10.674303 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c894050d-1f32-41d0-a5f2-7a66b122d7f3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:11.069577 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c894050d-1f32-41d0-a5f2-7a66b122d7f3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:11.088628 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c894050d-1f32-41d0-a5f2-7a66b122d7f3 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1522 microversion: 2.1 time: 0.493486 Jan 15 02:43:11.090043 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 192/417] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:10 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1522 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:11.672901 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-06fbe541-9562-4ab7-8477-4cdfb0daf5d5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:11.674158 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-06fbe541-9562-4ab7-8477-4cdfb0daf5d5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:11.720154 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-06fbe541-9562-4ab7-8477-4cdfb0daf5d5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:11.721477 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-06fbe541-9562-4ab7-8477-4cdfb0daf5d5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:11.723342 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-06fbe541-9562-4ab7-8477-4cdfb0daf5d5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:11.724904 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-06fbe541-9562-4ab7-8477-4cdfb0daf5d5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:11.725432 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6cb47c8e-b7a0-4218-a40e-3ae810577984 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:11.728113 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6cb47c8e-b7a0-4218-a40e-3ae810577984 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:11.747824 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6cb47c8e-b7a0-4218-a40e-3ae810577984 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:11.749188 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6cb47c8e-b7a0-4218-a40e-3ae810577984 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:11.751165 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6cb47c8e-b7a0-4218-a40e-3ae810577984 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:11.752465 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6cb47c8e-b7a0-4218-a40e-3ae810577984 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:12.935346 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-06fbe541-9562-4ab7-8477-4cdfb0daf5d5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:12.987304 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-06fbe541-9562-4ab7-8477-4cdfb0daf5d5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:13.040242 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-06fbe541-9562-4ab7-8477-4cdfb0daf5d5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:13.046704 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-06fbe541-9562-4ab7-8477-4cdfb0daf5d5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1810 microversion: 2.20 time: 1.437592 Jan 15 02:43:13.065051 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 226/418] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:43:11 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1810 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:43:13.065383 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6cb47c8e-b7a0-4218-a40e-3ae810577984 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:13.096399 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6cb47c8e-b7a0-4218-a40e-3ae810577984 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1711 microversion: 2.1 time: 1.405784 Jan 15 02:43:13.097030 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 193/419] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:11 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1711 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:13.106378 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b40c1e91-ceb9-4f55-b6b2-d4b8c53de099 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:13.117704 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-f800b0ca-cf97-4d5e-93c3-06de1f9c448b req-e95b422b-5549-4a43-8c7a-2119530115ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e90ce195-f423-416c-859f-a6423d99efe6", "name": "network-vif-unplugged", "status": "completed", "tag": "c7862d6e-e0db-48c4-b9d1-6f1b89942a89"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:43:13.120480 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b40c1e91-ceb9-4f55-b6b2-d4b8c53de099 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:13.139595 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b40c1e91-ceb9-4f55-b6b2-d4b8c53de099 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:13.140867 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b40c1e91-ceb9-4f55-b6b2-d4b8c53de099 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:13.142864 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b40c1e91-ceb9-4f55-b6b2-d4b8c53de099 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:13.144086 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b40c1e91-ceb9-4f55-b6b2-d4b8c53de099 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:13.148740 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:43:13.148740 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:43:13.164095 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-f800b0ca-cf97-4d5e-93c3-06de1f9c448b req-e95b422b-5549-4a43-8c7a-2119530115ce service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:13.165213 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-f800b0ca-cf97-4d5e-93c3-06de1f9c448b req-e95b422b-5549-4a43-8c7a-2119530115ce service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:13.192946 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-f800b0ca-cf97-4d5e-93c3-06de1f9c448b req-e95b422b-5549-4a43-8c7a-2119530115ce service nova] Creating event network-vif-unplugged:c7862d6e-e0db-48c4-b9d1-6f1b89942a89 for instance e90ce195-f423-416c-859f-a6423d99efe6 on hv-cinder-76330 Jan 15 02:43:13.200143 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-f800b0ca-cf97-4d5e-93c3-06de1f9c448b req-e95b422b-5549-4a43-8c7a-2119530115ce service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101438 Jan 15 02:43:13.201407 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 194/420] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:43:13 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:43:13.603067 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b40c1e91-ceb9-4f55-b6b2-d4b8c53de099 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:13.628952 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b40c1e91-ceb9-4f55-b6b2-d4b8c53de099 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1522 microversion: 2.1 time: 0.570508 Jan 15 02:43:13.632334 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 227/421] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:13 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1522 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:14.102934 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-eced79eb-557c-4d71-aba9-37001d53da37 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:14.104564 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-eced79eb-557c-4d71-aba9-37001d53da37 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:14.116808 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eced79eb-557c-4d71-aba9-37001d53da37 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:14.117670 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eced79eb-557c-4d71-aba9-37001d53da37 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:14.118562 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eced79eb-557c-4d71-aba9-37001d53da37 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:14.119064 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eced79eb-557c-4d71-aba9-37001d53da37 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:14.133399 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d9a43c54-d307-4b8c-ad9c-5dc8eaf6e930 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:14.134493 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d9a43c54-d307-4b8c-ad9c-5dc8eaf6e930 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:14.143507 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d9a43c54-d307-4b8c-ad9c-5dc8eaf6e930 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:14.144514 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d9a43c54-d307-4b8c-ad9c-5dc8eaf6e930 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:14.156499 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d9a43c54-d307-4b8c-ad9c-5dc8eaf6e930 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:14.157702 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d9a43c54-d307-4b8c-ad9c-5dc8eaf6e930 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:14.634781 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d9a43c54-d307-4b8c-ad9c-5dc8eaf6e930 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:14.648602 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d9a43c54-d307-4b8c-ad9c-5dc8eaf6e930 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1711 microversion: 2.1 time: 0.525281 Jan 15 02:43:14.669132 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 228/422] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:14 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1711 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:14.680690 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ac21f4a1-947c-4f61-9aa9-f973117ef1f4 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:14.681571 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ac21f4a1-947c-4f61-9aa9-f973117ef1f4 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:14.690481 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ac21f4a1-947c-4f61-9aa9-f973117ef1f4 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:14.691189 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ac21f4a1-947c-4f61-9aa9-f973117ef1f4 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:14.692849 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ac21f4a1-947c-4f61-9aa9-f973117ef1f4 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:14.693486 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ac21f4a1-947c-4f61-9aa9-f973117ef1f4 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:14.887718 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-ac21f4a1-947c-4f61-9aa9-f973117ef1f4 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:14.907866 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ac21f4a1-947c-4f61-9aa9-f973117ef1f4 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1480 microversion: 2.1 time: 0.236809 Jan 15 02:43:14.909291 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 229/423] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:14 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1480 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:15.343629 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-eced79eb-557c-4d71-aba9-37001d53da37 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:15.383509 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-eced79eb-557c-4d71-aba9-37001d53da37 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:15.401473 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-eced79eb-557c-4d71-aba9-37001d53da37 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:15.404677 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-eced79eb-557c-4d71-aba9-37001d53da37 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1810 microversion: 2.20 time: 1.318292 Jan 15 02:43:15.406124 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 195/424] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:43:14 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1810 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:43:15.462078 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-11873bb3-5ae5-4a3b-89f0-1c236c8a4dad req-bef5456f-479c-4506-b229-ee9bc2069894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e90ce195-f423-416c-859f-a6423d99efe6", "name": "network-vif-deleted", "tag": "c7862d6e-e0db-48c4-b9d1-6f1b89942a89"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:43:15.479182 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:43:15.479182 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:43:15.500711 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-11873bb3-5ae5-4a3b-89f0-1c236c8a4dad req-bef5456f-479c-4506-b229-ee9bc2069894 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:15.502984 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-11873bb3-5ae5-4a3b-89f0-1c236c8a4dad req-bef5456f-479c-4506-b229-ee9bc2069894 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:15.548204 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-11873bb3-5ae5-4a3b-89f0-1c236c8a4dad req-bef5456f-479c-4506-b229-ee9bc2069894 service nova] Creating event network-vif-deleted:c7862d6e-e0db-48c4-b9d1-6f1b89942a89 for instance e90ce195-f423-416c-859f-a6423d99efe6 on hv-cinder-76330 Jan 15 02:43:15.559578 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-11873bb3-5ae5-4a3b-89f0-1c236c8a4dad req-bef5456f-479c-4506-b229-ee9bc2069894 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117253 Jan 15 02:43:15.561293 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 230/425] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:43:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:43:15.690131 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2c3ce731-4ee4-45b0-90cd-ab4e29abeb06 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:15.692242 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2c3ce731-4ee4-45b0-90cd-ab4e29abeb06 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:15.712951 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2c3ce731-4ee4-45b0-90cd-ab4e29abeb06 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:15.714109 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2c3ce731-4ee4-45b0-90cd-ab4e29abeb06 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:15.715823 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2c3ce731-4ee4-45b0-90cd-ab4e29abeb06 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:15.717424 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2c3ce731-4ee4-45b0-90cd-ab4e29abeb06 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:15.994108 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d2ef7cad-3690-4ed5-a886-c327b0115c70 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:15.995128 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d2ef7cad-3690-4ed5-a886-c327b0115c70 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:16.015490 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d2ef7cad-3690-4ed5-a886-c327b0115c70 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:16.016101 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d2ef7cad-3690-4ed5-a886-c327b0115c70 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:16.018456 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d2ef7cad-3690-4ed5-a886-c327b0115c70 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:16.019031 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d2ef7cad-3690-4ed5-a886-c327b0115c70 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:16.126365 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d2ef7cad-3690-4ed5-a886-c327b0115c70 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:16.127198 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d2ef7cad-3690-4ed5-a886-c327b0115c70 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:16.128135 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.objects.instance [None req-d2ef7cad-3690-4ed5-a886-c327b0115c70 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lazy-loading 'fault' on Instance uuid e90ce195-f423-416c-859f-a6423d99efe6 {{(pid=94111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Jan 15 02:43:16.226103 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d2ef7cad-3690-4ed5-a886-c327b0115c70 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a581d3806bae40b78383585eef6b915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b64b200cb604abaa2041c6ac66f630e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:16.244471 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d2ef7cad-3690-4ed5-a886-c327b0115c70 tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 200 len: 1311 microversion: 2.1 time: 0.307715 Jan 15 02:43:16.247111 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 231/426] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:15 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 1311 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:16.326318 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-2c3ce731-4ee4-45b0-90cd-ab4e29abeb06 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:16.354429 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2c3ce731-4ee4-45b0-90cd-ab4e29abeb06 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1715 microversion: 2.1 time: 0.687160 Jan 15 02:43:16.367770 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 196/427] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:15 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1715 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:16.441907 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c9ea6936-c4fe-4a47-8619-c0df60143ce9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:16.443154 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c9ea6936-c4fe-4a47-8619-c0df60143ce9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:16.451739 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c9ea6936-c4fe-4a47-8619-c0df60143ce9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:16.452272 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c9ea6936-c4fe-4a47-8619-c0df60143ce9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:16.454342 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c9ea6936-c4fe-4a47-8619-c0df60143ce9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:16.454342 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c9ea6936-c4fe-4a47-8619-c0df60143ce9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:16.836513 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c9ea6936-c4fe-4a47-8619-c0df60143ce9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:16.867338 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c9ea6936-c4fe-4a47-8619-c0df60143ce9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:16.882385 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c9ea6936-c4fe-4a47-8619-c0df60143ce9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:16.884654 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c9ea6936-c4fe-4a47-8619-c0df60143ce9 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1797 microversion: 2.20 time: 0.456525 Jan 15 02:43:16.885739 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 232/428] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:43:16 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1797 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:43:17.293606 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-25678de3-5fe1-4a33-af15-bb37efa3854f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:17.294949 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-25678de3-5fe1-4a33-af15-bb37efa3854f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] [instance: e90ce195-f423-416c-859f-a6423d99efe6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:17.310379 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-25678de3-5fe1-4a33-af15-bb37efa3854f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:17.311341 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-25678de3-5fe1-4a33-af15-bb37efa3854f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:17.312727 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-25678de3-5fe1-4a33-af15-bb37efa3854f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:17.313608 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-25678de3-5fe1-4a33-af15-bb37efa3854f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:17.420624 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-25678de3-5fe1-4a33-af15-bb37efa3854f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] HTTP exception thrown: Instance e90ce195-f423-416c-859f-a6423d99efe6 could not be found. Jan 15 02:43:17.421787 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-25678de3-5fe1-4a33-af15-bb37efa3854f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] Returning 404 to user: Instance e90ce195-f423-416c-859f-a6423d99efe6 could not be found. {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:43:17.423405 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-25678de3-5fe1-4a33-af15-bb37efa3854f tempest-ServerRescueNegativeTestJSON-611746915 tempest-ServerRescueNegativeTestJSON-611746915] 10.222.0.37 "GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6" status: 404 len: 111 microversion: 2.1 time: 0.149094 Jan 15 02:43:17.424645 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 197/429] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:17 2021] GET /compute/v2.1/servers/e90ce195-f423-416c-859f-a6423d99efe6 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:43:20.914143 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4a49feb8-2f45-45a8-950d-be687b4d7512 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1242196226", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2069070189", "security_groups": [{"name": "tempest-TestShelveInstance-1904140384"}], "networks": [{"uuid": "521e2a79-be5d-4fa6-8eb8-43b75fdf9d47"}], "block_device_mapping_v2": [{"uuid": "761bec5b-2f3f-43d6-83cc-ad9fd569cf85", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:43:21.215746 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-4a49feb8-2f45-45a8-950d-be687b4d7512 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] validate_networks() for [('521e2a79-be5d-4fa6-8eb8-43b75fdf9d47', None, None, None)] {{(pid=94111) validate_networks /opt/stack/nova/nova/network/neutron.py:2340}} Jan 15 02:43:22.157671 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-4a49feb8-2f45-45a8-950d-be687b4d7512 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Flavor limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 02:43:22.158303 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-4a49feb8-2f45-45a8-950d-be687b4d7512 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Image limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Jan 15 02:43:22.158663 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-4a49feb8-2f45-45a8-950d-be687b4d7512 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Flavor pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 02:43:22.159342 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-4a49feb8-2f45-45a8-950d-be687b4d7512 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Image pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Jan 15 02:43:22.159965 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-4a49feb8-2f45-45a8-950d-be687b4d7512 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Jan 15 02:43:22.170999 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4a49feb8-2f45-45a8-950d-be687b4d7512 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:22.171505 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4a49feb8-2f45-45a8-950d-be687b4d7512 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:22.172382 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4a49feb8-2f45-45a8-950d-be687b4d7512 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:22.172884 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4a49feb8-2f45-45a8-950d-be687b4d7512 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:22.197830 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-4a49feb8-2f45-45a8-950d-be687b4d7512 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Getting quotas for project 813af52eb922416fbfc79ce6c132a7d2. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:43:22.202372 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-4a49feb8-2f45-45a8-950d-be687b4d7512 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Getting quotas for user 6660cbc87b9f42a2b5fdc179d815d734 and project 813af52eb922416fbfc79ce6c132a7d2. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:43:22.318186 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4a49feb8-2f45-45a8-950d-be687b4d7512 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Going to run 1 instances... {{(pid=94111) _provision_instances /opt/stack/nova/nova/compute/api.py:1263}} Jan 15 02:43:22.320642 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4a49feb8-2f45-45a8-950d-be687b4d7512 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='761bec5b-2f3f-43d6-83cc-ad9fd569cf85',volume_size=None,volume_type=None)] {{(pid=94111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1661}} Jan 15 02:43:22.555620 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4a49feb8-2f45-45a8-950d-be687b4d7512 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 410 microversion: 2.1 time: 1.651584 Jan 15 02:43:22.556548 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 233/430] 10.222.0.37 () {60 vars in 1137 bytes} [Fri Jan 15 02:43:20 2021] POST /compute/v2.1/servers => generated 410 bytes in 1653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 02:43:22.587072 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-8067a4a5-55b4-4b7c-80f1-9372fa1237e2 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:22.587437 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8067a4a5-55b4-4b7c-80f1-9372fa1237e2 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:22.898002 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-8067a4a5-55b4-4b7c-80f1-9372fa1237e2 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:22.908224 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-8067a4a5-55b4-4b7c-80f1-9372fa1237e2 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1089 microversion: 2.1 time: 0.343776 Jan 15 02:43:22.909160 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 198/431] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:22 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1089 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:23.965497 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-09cbdf22-05f2-47ef-a0cd-0b900b8433f6 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:23.967839 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-09cbdf22-05f2-47ef-a0cd-0b900b8433f6 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:23.991812 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-09cbdf22-05f2-47ef-a0cd-0b900b8433f6 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:23.993751 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-09cbdf22-05f2-47ef-a0cd-0b900b8433f6 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:23.997251 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-09cbdf22-05f2-47ef-a0cd-0b900b8433f6 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:23.998663 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-09cbdf22-05f2-47ef-a0cd-0b900b8433f6 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:24.518516 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-09cbdf22-05f2-47ef-a0cd-0b900b8433f6 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:24.546070 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-09cbdf22-05f2-47ef-a0cd-0b900b8433f6 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1195 microversion: 2.1 time: 0.621939 Jan 15 02:43:24.559238 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 234/432] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:23 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1195 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:25.586018 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ff1acd5a-883f-46dc-9829-76a1d79f5d75 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:25.588552 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ff1acd5a-883f-46dc-9829-76a1d79f5d75 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:25.607660 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ff1acd5a-883f-46dc-9829-76a1d79f5d75 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:25.609158 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ff1acd5a-883f-46dc-9829-76a1d79f5d75 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:25.611013 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ff1acd5a-883f-46dc-9829-76a1d79f5d75 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:25.612208 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ff1acd5a-883f-46dc-9829-76a1d79f5d75 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:26.251555 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-ff1acd5a-883f-46dc-9829-76a1d79f5d75 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:26.261492 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ff1acd5a-883f-46dc-9829-76a1d79f5d75 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1205 microversion: 2.1 time: 0.698196 Jan 15 02:43:26.273079 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 199/433] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:25 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1205 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:27.287836 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-99f33136-d29c-4cc6-b061-be13a362bb07 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:27.288523 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-99f33136-d29c-4cc6-b061-be13a362bb07 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:27.312974 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-99f33136-d29c-4cc6-b061-be13a362bb07 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:27.313684 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-99f33136-d29c-4cc6-b061-be13a362bb07 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:27.314608 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-99f33136-d29c-4cc6-b061-be13a362bb07 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:27.315112 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-99f33136-d29c-4cc6-b061-be13a362bb07 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:28.081082 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-99f33136-d29c-4cc6-b061-be13a362bb07 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:28.103895 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-99f33136-d29c-4cc6-b061-be13a362bb07 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1265 microversion: 2.1 time: 0.826219 Jan 15 02:43:28.104960 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 235/434] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:27 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1265 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:28.577783 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-5eedc52d-c076-4004-82c8-95ef74cf6c74 req-a46c6d17-48d7-4ffb-b16f-6145171a2f37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19d658a3-85b8-4130-b672-9843892a6fa5", "tag": "f6b12a20-2846-4e92-bcbd-958c13c5e899"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:43:28.591285 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:43:28.591285 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:43:28.609989 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-5eedc52d-c076-4004-82c8-95ef74cf6c74 req-a46c6d17-48d7-4ffb-b16f-6145171a2f37 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:28.611142 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-5eedc52d-c076-4004-82c8-95ef74cf6c74 req-a46c6d17-48d7-4ffb-b16f-6145171a2f37 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:28.704956 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-5eedc52d-c076-4004-82c8-95ef74cf6c74 req-a46c6d17-48d7-4ffb-b16f-6145171a2f37 service nova] Creating event network-changed:f6b12a20-2846-4e92-bcbd-958c13c5e899 for instance 19d658a3-85b8-4130-b672-9843892a6fa5 on hv-cinder-76330 Jan 15 02:43:28.735608 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-5eedc52d-c076-4004-82c8-95ef74cf6c74 req-a46c6d17-48d7-4ffb-b16f-6145171a2f37 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174130 Jan 15 02:43:28.736993 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 200/435] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:43:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:43:29.173394 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-43debf7d-d599-4ed6-8327-b5725b552f4b tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:29.175394 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-43debf7d-d599-4ed6-8327-b5725b552f4b tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:29.193708 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-43debf7d-d599-4ed6-8327-b5725b552f4b tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:29.195337 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-43debf7d-d599-4ed6-8327-b5725b552f4b tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:29.197719 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-43debf7d-d599-4ed6-8327-b5725b552f4b tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:29.198738 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-43debf7d-d599-4ed6-8327-b5725b552f4b tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:29.720282 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-43debf7d-d599-4ed6-8327-b5725b552f4b tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:29.750190 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-43debf7d-d599-4ed6-8327-b5725b552f4b tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1265 microversion: 2.1 time: 0.623797 Jan 15 02:43:29.751192 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 236/436] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:29 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1265 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:30.789706 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c0b2f2b4-b762-4ecb-96fd-0d1c5b11baae tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:30.791310 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c0b2f2b4-b762-4ecb-96fd-0d1c5b11baae tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:30.809903 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c0b2f2b4-b762-4ecb-96fd-0d1c5b11baae tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:30.810815 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c0b2f2b4-b762-4ecb-96fd-0d1c5b11baae tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:30.812379 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c0b2f2b4-b762-4ecb-96fd-0d1c5b11baae tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:30.813294 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c0b2f2b4-b762-4ecb-96fd-0d1c5b11baae tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:31.275871 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c0b2f2b4-b762-4ecb-96fd-0d1c5b11baae tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:31.293924 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c0b2f2b4-b762-4ecb-96fd-0d1c5b11baae tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1265 microversion: 2.1 time: 0.519042 Jan 15 02:43:31.295894 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 201/437] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:30 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1265 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:32.349347 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e8cb208e-9c83-4a90-8f09-48ea381675a2 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:32.351846 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e8cb208e-9c83-4a90-8f09-48ea381675a2 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:32.369958 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e8cb208e-9c83-4a90-8f09-48ea381675a2 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:32.370973 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e8cb208e-9c83-4a90-8f09-48ea381675a2 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:32.373298 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e8cb208e-9c83-4a90-8f09-48ea381675a2 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:32.375367 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e8cb208e-9c83-4a90-8f09-48ea381675a2 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:32.813668 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-858971ba-5028-4250-b002-30ece97fb249 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-232475000", "imageRef": "1807a1cb-835d-4a56-8751-82ffa40b12c9", "flavorRef": "452", "networks": [{"uuid": "570f6e31-1bda-4ebb-b8b9-ce9a0b49f0a4"}]}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:43:32.913438 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e8cb208e-9c83-4a90-8f09-48ea381675a2 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:32.933224 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e8cb208e-9c83-4a90-8f09-48ea381675a2 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1265 microversion: 2.1 time: 0.605803 Jan 15 02:43:32.935105 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 237/438] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:32 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1265 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:32.993238 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-858971ba-5028-4250-b002-30ece97fb249 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] validate_networks() for [('570f6e31-1bda-4ebb-b8b9-ce9a0b49f0a4', None, None, None)] {{(pid=94112) validate_networks /opt/stack/nova/nova/network/neutron.py:2340}} Jan 15 02:43:33.972949 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3c97a630-6ecb-4455-b72e-f884efd84e9a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:33.974417 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3c97a630-6ecb-4455-b72e-f884efd84e9a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:33.992058 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3c97a630-6ecb-4455-b72e-f884efd84e9a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:33.993116 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3c97a630-6ecb-4455-b72e-f884efd84e9a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:33.994710 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3c97a630-6ecb-4455-b72e-f884efd84e9a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:33.995756 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3c97a630-6ecb-4455-b72e-f884efd84e9a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:34.120876 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-858971ba-5028-4250-b002-30ece97fb249 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Flavor limits 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 02:43:34.121397 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-858971ba-5028-4250-b002-30ece97fb249 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Image limits 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Jan 15 02:43:34.122123 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-858971ba-5028-4250-b002-30ece97fb249 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Flavor pref 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 02:43:34.122588 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-858971ba-5028-4250-b002-30ece97fb249 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Image pref 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Jan 15 02:43:34.123052 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-858971ba-5028-4250-b002-30ece97fb249 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Jan 15 02:43:34.148140 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-858971ba-5028-4250-b002-30ece97fb249 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:34.149616 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-858971ba-5028-4250-b002-30ece97fb249 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:34.151624 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-858971ba-5028-4250-b002-30ece97fb249 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:34.152675 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-858971ba-5028-4250-b002-30ece97fb249 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:34.192868 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-858971ba-5028-4250-b002-30ece97fb249 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Getting quotas for project dd56ed8011104bf0a99ad88d8911ead9. Resources: {'ram', 'instances', 'cores'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:43:34.201227 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-858971ba-5028-4250-b002-30ece97fb249 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Getting quotas for user 63160ec41a3b4c9e839a6aefe3c269d0 and project dd56ed8011104bf0a99ad88d8911ead9. Resources: {'ram', 'instances', 'cores'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:43:34.232443 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-858971ba-5028-4250-b002-30ece97fb249 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Going to run 1 instances... {{(pid=94112) _provision_instances /opt/stack/nova/nova/compute/api.py:1263}} Jan 15 02:43:34.233523 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-858971ba-5028-4250-b002-30ece97fb249 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 1e1481d5-324e-4893-b3fa-9815f0688933] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1807a1cb-835d-4a56-8751-82ffa40b12c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94112) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1661}} Jan 15 02:43:34.349576 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-858971ba-5028-4250-b002-30ece97fb249 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.830725 Jan 15 02:43:34.351359 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 202/439] 10.222.0.37 () {60 vars in 1137 bytes} [Fri Jan 15 02:43:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 1835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 02:43:34.371346 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2477938b-764c-4af5-9186-78e95f190731 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:34.372290 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2477938b-764c-4af5-9186-78e95f190731 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 1e1481d5-324e-4893-b3fa-9815f0688933] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:34.500841 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-2477938b-764c-4af5-9186-78e95f190731 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:34.512223 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2477938b-764c-4af5-9186-78e95f190731 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933" status: 200 len: 1217 microversion: 2.1 time: 0.153634 Jan 15 02:43:34.513216 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 203/440] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:34 2021] GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:34.655895 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3c97a630-6ecb-4455-b72e-f884efd84e9a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:34.667627 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3c97a630-6ecb-4455-b72e-f884efd84e9a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1265 microversion: 2.1 time: 0.715060 Jan 15 02:43:34.668526 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 238/441] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:33 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1265 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:35.538522 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-eaa5c772-2c33-49cd-b4e1-4e69994e08ba tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:35.539196 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-eaa5c772-2c33-49cd-b4e1-4e69994e08ba tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 1e1481d5-324e-4893-b3fa-9815f0688933] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:35.547741 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eaa5c772-2c33-49cd-b4e1-4e69994e08ba tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:35.548258 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eaa5c772-2c33-49cd-b4e1-4e69994e08ba tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:35.549172 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eaa5c772-2c33-49cd-b4e1-4e69994e08ba tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:35.549679 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eaa5c772-2c33-49cd-b4e1-4e69994e08ba tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:35.706498 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-45696539-c2a5-48a4-9190-9f57a4faaa5b tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:35.707868 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-45696539-c2a5-48a4-9190-9f57a4faaa5b tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:35.711838 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-eaa5c772-2c33-49cd-b4e1-4e69994e08ba tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:35.719266 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-45696539-c2a5-48a4-9190-9f57a4faaa5b tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:35.719780 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-45696539-c2a5-48a4-9190-9f57a4faaa5b tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:35.720715 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-45696539-c2a5-48a4-9190-9f57a4faaa5b tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:35.721323 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-45696539-c2a5-48a4-9190-9f57a4faaa5b tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:35.730392 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-eaa5c772-2c33-49cd-b4e1-4e69994e08ba tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933" status: 200 len: 1269 microversion: 2.1 time: 0.201982 Jan 15 02:43:35.731578 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 204/442] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:35 2021] GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933 => generated 1269 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:36.000683 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-45696539-c2a5-48a4-9190-9f57a4faaa5b tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:36.017964 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-45696539-c2a5-48a4-9190-9f57a4faaa5b tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1265 microversion: 2.1 time: 0.332081 Jan 15 02:43:36.019141 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 239/443] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:35 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1265 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:36.767644 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5ff47e05-300c-4689-bf30-7380f1fbd55a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:36.769954 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5ff47e05-300c-4689-bf30-7380f1fbd55a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 1e1481d5-324e-4893-b3fa-9815f0688933] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:36.785762 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5ff47e05-300c-4689-bf30-7380f1fbd55a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:36.786464 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5ff47e05-300c-4689-bf30-7380f1fbd55a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:36.787499 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5ff47e05-300c-4689-bf30-7380f1fbd55a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:36.788289 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5ff47e05-300c-4689-bf30-7380f1fbd55a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:37.024635 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-5ff47e05-300c-4689-bf30-7380f1fbd55a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:37.034380 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5ff47e05-300c-4689-bf30-7380f1fbd55a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933" status: 200 len: 1275 microversion: 2.1 time: 0.286823 Jan 15 02:43:37.036342 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 205/444] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:36 2021] GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933 => generated 1275 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:37.055649 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-bdac316b-a7eb-46ab-a676-795f696983bf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:37.056977 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-bdac316b-a7eb-46ab-a676-795f696983bf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:37.073736 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bdac316b-a7eb-46ab-a676-795f696983bf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:37.074686 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bdac316b-a7eb-46ab-a676-795f696983bf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:37.076363 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bdac316b-a7eb-46ab-a676-795f696983bf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:37.077343 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bdac316b-a7eb-46ab-a676-795f696983bf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:37.327681 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5cec4037-1488-4922-b398-b32a06aa3c48 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a798a942-3c14-439a-986e-81c95606240b", "device": "/dev/sdb"}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:43:37.329643 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5cec4037-1488-4922-b398-b32a06aa3c48 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:37.339140 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5cec4037-1488-4922-b398-b32a06aa3c48 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:37.339655 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5cec4037-1488-4922-b398-b32a06aa3c48 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:37.340542 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5cec4037-1488-4922-b398-b32a06aa3c48 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:37.341072 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5cec4037-1488-4922-b398-b32a06aa3c48 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:37.386414 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-bdac316b-a7eb-46ab-a676-795f696983bf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:37.398196 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-bdac316b-a7eb-46ab-a676-795f696983bf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1265 microversion: 2.1 time: 0.363202 Jan 15 02:43:37.399012 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 240/445] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:37 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1265 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:43:37.862493 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5cec4037-1488-4922-b398-b32a06aa3c48 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "POST /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.543677 Jan 15 02:43:37.865154 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 206/446] 10.222.0.37 () {60 vars in 1313 bytes} [Fri Jan 15 02:43:37 2021] POST /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6/os-volume_attachments => generated 194 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:43:38.060394 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d2a82de3-305a-44eb-8760-d2ac232d0c1c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:38.061485 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d2a82de3-305a-44eb-8760-d2ac232d0c1c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 1e1481d5-324e-4893-b3fa-9815f0688933] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:38.070738 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d2a82de3-305a-44eb-8760-d2ac232d0c1c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:38.071684 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d2a82de3-305a-44eb-8760-d2ac232d0c1c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:38.072803 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d2a82de3-305a-44eb-8760-d2ac232d0c1c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:38.073584 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d2a82de3-305a-44eb-8760-d2ac232d0c1c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:38.415472 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d2a82de3-305a-44eb-8760-d2ac232d0c1c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:38.423635 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-cfc4bd8e-218a-4058-be5c-5dbc90f8fe51 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:38.424448 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-cfc4bd8e-218a-4058-be5c-5dbc90f8fe51 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:38.426029 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d2a82de3-305a-44eb-8760-d2ac232d0c1c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933" status: 200 len: 1317 microversion: 2.1 time: 0.375319 Jan 15 02:43:38.427063 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 241/447] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:38 2021] GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933 => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:38.435044 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cfc4bd8e-218a-4058-be5c-5dbc90f8fe51 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:38.435466 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cfc4bd8e-218a-4058-be5c-5dbc90f8fe51 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:38.436576 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cfc4bd8e-218a-4058-be5c-5dbc90f8fe51 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:38.437094 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cfc4bd8e-218a-4058-be5c-5dbc90f8fe51 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:38.873841 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-cfc4bd8e-218a-4058-be5c-5dbc90f8fe51 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:38.892729 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-cfc4bd8e-218a-4058-be5c-5dbc90f8fe51 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1265 microversion: 2.1 time: 0.479458 Jan 15 02:43:38.894818 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 207/448] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:38 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1265 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:39.450461 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7a5fe770-bcb9-4134-ba5e-e6a83dd18ef8 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:39.451270 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-7a5fe770-bcb9-4134-ba5e-e6a83dd18ef8 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 1e1481d5-324e-4893-b3fa-9815f0688933] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:39.462050 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7a5fe770-bcb9-4134-ba5e-e6a83dd18ef8 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:39.462981 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7a5fe770-bcb9-4134-ba5e-e6a83dd18ef8 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:39.464913 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7a5fe770-bcb9-4134-ba5e-e6a83dd18ef8 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:39.465702 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7a5fe770-bcb9-4134-ba5e-e6a83dd18ef8 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:39.681123 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-f151672e-2799-446c-9202-5ff20d1a8931 req-f8b063f8-368b-4736-a688-c655bd98de1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d658a3-85b8-4130-b672-9843892a6fa5", "name": "network-vif-plugged", "status": "completed", "tag": "f6b12a20-2846-4e92-bcbd-958c13c5e899"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:43:39.688935 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:43:39.688935 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:43:39.717158 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-f151672e-2799-446c-9202-5ff20d1a8931 req-f8b063f8-368b-4736-a688-c655bd98de1f service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:39.723792 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-f151672e-2799-446c-9202-5ff20d1a8931 req-f8b063f8-368b-4736-a688-c655bd98de1f service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:39.774798 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-f151672e-2799-446c-9202-5ff20d1a8931 req-f8b063f8-368b-4736-a688-c655bd98de1f service nova] Creating event network-vif-plugged:f6b12a20-2846-4e92-bcbd-958c13c5e899 for instance 19d658a3-85b8-4130-b672-9843892a6fa5 on hv-cinder-76330 Jan 15 02:43:39.795961 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-f151672e-2799-446c-9202-5ff20d1a8931 req-f8b063f8-368b-4736-a688-c655bd98de1f service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142437 Jan 15 02:43:39.797566 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 208/449] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:43:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:43:39.923784 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-357bfccf-5ad1-4bc1-b536-64cfd9780b4c tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:39.929870 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-357bfccf-5ad1-4bc1-b536-64cfd9780b4c tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:39.968194 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-357bfccf-5ad1-4bc1-b536-64cfd9780b4c tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:39.969674 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-357bfccf-5ad1-4bc1-b536-64cfd9780b4c tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:39.973789 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-357bfccf-5ad1-4bc1-b536-64cfd9780b4c tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:39.975038 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-357bfccf-5ad1-4bc1-b536-64cfd9780b4c tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:40.001952 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-7a5fe770-bcb9-4134-ba5e-e6a83dd18ef8 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:40.013725 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-7a5fe770-bcb9-4134-ba5e-e6a83dd18ef8 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933" status: 200 len: 1317 microversion: 2.1 time: 0.573233 Jan 15 02:43:40.024816 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 242/450] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:39 2021] GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933 => generated 1317 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:40.042480 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-f6f47d49-d625-4add-9464-a00df294558c req-8a2a51a2-870e-4252-9286-2742f8dc5871 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e1481d5-324e-4893-b3fa-9815f0688933", "tag": "4d1d06ee-8d7d-488b-b0e5-bf3a82f8ed58"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:43:40.052196 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:43:40.052196 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:43:40.063346 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-f6f47d49-d625-4add-9464-a00df294558c req-8a2a51a2-870e-4252-9286-2742f8dc5871 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:40.064282 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-f6f47d49-d625-4add-9464-a00df294558c req-8a2a51a2-870e-4252-9286-2742f8dc5871 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:40.086449 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-f6f47d49-d625-4add-9464-a00df294558c req-8a2a51a2-870e-4252-9286-2742f8dc5871 service nova] Creating event network-changed:4d1d06ee-8d7d-488b-b0e5-bf3a82f8ed58 for instance 1e1481d5-324e-4893-b3fa-9815f0688933 on hv-cinder-76330 Jan 15 02:43:40.094907 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-f6f47d49-d625-4add-9464-a00df294558c req-8a2a51a2-870e-4252-9286-2742f8dc5871 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068188 Jan 15 02:43:40.097745 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 243/451] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:43:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:43:40.932680 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-357bfccf-5ad1-4bc1-b536-64cfd9780b4c tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:40.951311 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-357bfccf-5ad1-4bc1-b536-64cfd9780b4c tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1265 microversion: 2.1 time: 1.041354 Jan 15 02:43:40.952750 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 209/452] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:39 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1265 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:41.039988 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-33cce82f-f379-4bda-be1a-42dfe1f0197a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:41.041287 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-33cce82f-f379-4bda-be1a-42dfe1f0197a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 1e1481d5-324e-4893-b3fa-9815f0688933] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:41.051607 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-33cce82f-f379-4bda-be1a-42dfe1f0197a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:41.052099 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-33cce82f-f379-4bda-be1a-42dfe1f0197a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:41.053250 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-33cce82f-f379-4bda-be1a-42dfe1f0197a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:41.053793 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-33cce82f-f379-4bda-be1a-42dfe1f0197a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:41.340028 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-33cce82f-f379-4bda-be1a-42dfe1f0197a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:41.359317 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-33cce82f-f379-4bda-be1a-42dfe1f0197a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933" status: 200 len: 1317 microversion: 2.1 time: 0.329374 Jan 15 02:43:41.365188 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 244/453] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:41 2021] GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933 => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:41.989464 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-bec67e18-5c9c-4bbf-9bca-14be2b8c1e15 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:41.990234 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-bec67e18-5c9c-4bbf-9bca-14be2b8c1e15 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:41.999241 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bec67e18-5c9c-4bbf-9bca-14be2b8c1e15 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:41.999977 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bec67e18-5c9c-4bbf-9bca-14be2b8c1e15 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:42.000856 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bec67e18-5c9c-4bbf-9bca-14be2b8c1e15 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:42.001417 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bec67e18-5c9c-4bbf-9bca-14be2b8c1e15 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:42.396798 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a2e6618e-71d2-491d-994d-cff5f47a6d03 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:42.397937 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a2e6618e-71d2-491d-994d-cff5f47a6d03 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 1e1481d5-324e-4893-b3fa-9815f0688933] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:42.407413 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a2e6618e-71d2-491d-994d-cff5f47a6d03 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:42.407931 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a2e6618e-71d2-491d-994d-cff5f47a6d03 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:42.408788 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a2e6618e-71d2-491d-994d-cff5f47a6d03 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:42.409356 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a2e6618e-71d2-491d-994d-cff5f47a6d03 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:42.499418 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-bec67e18-5c9c-4bbf-9bca-14be2b8c1e15 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:42.523267 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-bec67e18-5c9c-4bbf-9bca-14be2b8c1e15 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1449 microversion: 2.1 time: 0.543551 Jan 15 02:43:42.526147 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 210/454] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:41 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1449 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:43:42.559974 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d880cca7-5b98-4e10-ae45-f38ba1b01c84 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:42.561835 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d880cca7-5b98-4e10-ae45-f38ba1b01c84 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:42.580871 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d880cca7-5b98-4e10-ae45-f38ba1b01c84 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:42.582765 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d880cca7-5b98-4e10-ae45-f38ba1b01c84 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:42.588828 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d880cca7-5b98-4e10-ae45-f38ba1b01c84 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:42.589952 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d880cca7-5b98-4e10-ae45-f38ba1b01c84 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:42.760462 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a2e6618e-71d2-491d-994d-cff5f47a6d03 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:42.786174 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a2e6618e-71d2-491d-994d-cff5f47a6d03 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933" status: 200 len: 1317 microversion: 2.1 time: 0.399628 Jan 15 02:43:42.787344 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 245/455] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:42 2021] GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933 => generated 1317 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:43:42.921991 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d880cca7-5b98-4e10-ae45-f38ba1b01c84 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:42.932315 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d880cca7-5b98-4e10-ae45-f38ba1b01c84 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1449 microversion: 2.1 time: 0.391405 Jan 15 02:43:42.932950 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 211/456] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:42 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1449 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:42.955498 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f764afdb-2b52-4651-bf91-06f6797bfbb0 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Action: 'create', calling method: .version_select at 0x7f878f17cf28>, body: {"pool": null} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:43:43.812291 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1f6b46f2-3680-4fca-8930-d8255ce72d7c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:43.812971 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1f6b46f2-3680-4fca-8930-d8255ce72d7c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 1e1481d5-324e-4893-b3fa-9815f0688933] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:43.820959 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1f6b46f2-3680-4fca-8930-d8255ce72d7c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:43.821503 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1f6b46f2-3680-4fca-8930-d8255ce72d7c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:43.822336 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1f6b46f2-3680-4fca-8930-d8255ce72d7c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:43.822834 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1f6b46f2-3680-4fca-8930-d8255ce72d7c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:44.106791 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1f6b46f2-3680-4fca-8930-d8255ce72d7c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:44.116677 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1f6b46f2-3680-4fca-8930-d8255ce72d7c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933" status: 200 len: 1317 microversion: 2.1 time: 0.316211 Jan 15 02:43:44.117333 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 212/457] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:43 2021] GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:43:45.141454 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d580ac91-0159-4bff-991c-7cfb30fd5b0f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:45.142059 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d580ac91-0159-4bff-991c-7cfb30fd5b0f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 1e1481d5-324e-4893-b3fa-9815f0688933] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:45.151766 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d580ac91-0159-4bff-991c-7cfb30fd5b0f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:45.152273 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d580ac91-0159-4bff-991c-7cfb30fd5b0f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:45.153154 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d580ac91-0159-4bff-991c-7cfb30fd5b0f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:45.153654 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d580ac91-0159-4bff-991c-7cfb30fd5b0f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:45.265300 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f764afdb-2b52-4651-bf91-06f6797bfbb0 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.318889 Jan 15 02:43:45.266108 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 246/458] 10.222.0.37 () {60 vars in 1160 bytes} [Fri Jan 15 02:43:42 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:43:45.286070 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a19eddfa-aa2b-4fc0-adc1-18d960ec6aaf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Action: 'action', calling method: .version_select at 0x7f87907747b8>, body: {"addFloatingIp": {"address": "172.27.1.104"}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:43:45.287431 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a19eddfa-aa2b-4fc0-adc1-18d960ec6aaf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:45.296944 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a19eddfa-aa2b-4fc0-adc1-18d960ec6aaf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:45.297330 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a19eddfa-aa2b-4fc0-adc1-18d960ec6aaf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:45.298097 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a19eddfa-aa2b-4fc0-adc1-18d960ec6aaf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:45.298509 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a19eddfa-aa2b-4fc0-adc1-18d960ec6aaf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:45.375933 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a19eddfa-aa2b-4fc0-adc1-18d960ec6aaf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Acquired lock "refresh_cache-19d658a3-85b8-4130-b672-9843892a6fa5" {{(pid=94111) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Jan 15 02:43:45.452159 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d580ac91-0159-4bff-991c-7cfb30fd5b0f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:45.464526 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d580ac91-0159-4bff-991c-7cfb30fd5b0f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933" status: 200 len: 1317 microversion: 2.1 time: 0.332537 Jan 15 02:43:45.465754 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 213/459] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:45 2021] GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933 => generated 1317 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:43:45.803182 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-fdca9a5c-d181-4c29-98d8-8c7c29df2419 req-e2cd9844-a5fc-4f9c-825f-0ca70a1b7d0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e1481d5-324e-4893-b3fa-9815f0688933", "name": "network-vif-plugged", "status": "completed", "tag": "4d1d06ee-8d7d-488b-b0e5-bf3a82f8ed58"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:43:45.819523 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:43:45.819523 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:43:45.836900 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-fdca9a5c-d181-4c29-98d8-8c7c29df2419 req-e2cd9844-a5fc-4f9c-825f-0ca70a1b7d0b service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:45.838367 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-fdca9a5c-d181-4c29-98d8-8c7c29df2419 req-e2cd9844-a5fc-4f9c-825f-0ca70a1b7d0b service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:45.876159 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-fdca9a5c-d181-4c29-98d8-8c7c29df2419 req-e2cd9844-a5fc-4f9c-825f-0ca70a1b7d0b service nova] Creating event network-vif-plugged:4d1d06ee-8d7d-488b-b0e5-bf3a82f8ed58 for instance 1e1481d5-324e-4893-b3fa-9815f0688933 on hv-cinder-76330 Jan 15 02:43:45.886329 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-fdca9a5c-d181-4c29-98d8-8c7c29df2419 req-e2cd9844-a5fc-4f9c-825f-0ca70a1b7d0b service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098395 Jan 15 02:43:45.887089 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 214/460] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:43:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:43:46.498901 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c6f934a2-286f-4911-a8f0-a66ad3bdfae2 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:46.499689 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c6f934a2-286f-4911-a8f0-a66ad3bdfae2 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 1e1481d5-324e-4893-b3fa-9815f0688933] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:46.508666 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c6f934a2-286f-4911-a8f0-a66ad3bdfae2 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:46.509245 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c6f934a2-286f-4911-a8f0-a66ad3bdfae2 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:46.510112 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c6f934a2-286f-4911-a8f0-a66ad3bdfae2 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:46.510614 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c6f934a2-286f-4911-a8f0-a66ad3bdfae2 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:46.816711 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c6f934a2-286f-4911-a8f0-a66ad3bdfae2 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:46.826038 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c6f934a2-286f-4911-a8f0-a66ad3bdfae2 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933" status: 200 len: 1317 microversion: 2.1 time: 0.337347 Jan 15 02:43:46.826990 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 215/461] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:46 2021] GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933 => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:43:47.643361 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-a19eddfa-aa2b-4fc0-adc1-18d960ec6aaf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Building network info cache for instance {{(pid=94111) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1831}} Jan 15 02:43:47.665481 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-c86696de-58d5-404b-9044-fb80439883b0 req-5665a7c5-31cc-4bca-bee8-2d890da94ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19d658a3-85b8-4130-b672-9843892a6fa5", "tag": "f6b12a20-2846-4e92-bcbd-958c13c5e899"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:43:47.686146 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:43:47.686146 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:43:47.709278 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-c86696de-58d5-404b-9044-fb80439883b0 req-5665a7c5-31cc-4bca-bee8-2d890da94ba2 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:47.710216 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-c86696de-58d5-404b-9044-fb80439883b0 req-5665a7c5-31cc-4bca-bee8-2d890da94ba2 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:47.747855 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-c86696de-58d5-404b-9044-fb80439883b0 req-5665a7c5-31cc-4bca-bee8-2d890da94ba2 service nova] Creating event network-changed:f6b12a20-2846-4e92-bcbd-958c13c5e899 for instance 19d658a3-85b8-4130-b672-9843892a6fa5 on hv-cinder-76330 Jan 15 02:43:47.758598 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-c86696de-58d5-404b-9044-fb80439883b0 req-5665a7c5-31cc-4bca-bee8-2d890da94ba2 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102575 Jan 15 02:43:47.759757 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 216/462] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:43:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:43:47.856202 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c483a529-ce9a-4043-a33d-aebdaa389c3b tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:47.857486 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c483a529-ce9a-4043-a33d-aebdaa389c3b tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 1e1481d5-324e-4893-b3fa-9815f0688933] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:47.867713 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c483a529-ce9a-4043-a33d-aebdaa389c3b tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:47.868254 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c483a529-ce9a-4043-a33d-aebdaa389c3b tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:47.869305 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c483a529-ce9a-4043-a33d-aebdaa389c3b tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:47.869819 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c483a529-ce9a-4043-a33d-aebdaa389c3b tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:48.205337 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c483a529-ce9a-4043-a33d-aebdaa389c3b tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:48.215480 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c483a529-ce9a-4043-a33d-aebdaa389c3b tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933" status: 200 len: 1317 microversion: 2.1 time: 0.370933 Jan 15 02:43:48.216284 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 217/463] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:47 2021] GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933 => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:43:48.964519 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-a19eddfa-aa2b-4fc0-adc1-18d960ec6aaf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Updating instance_info_cache with network_info: [{"id": "f6b12a20-2846-4e92-bcbd-958c13c5e899", "address": "fa:16:3e:0e:44:c0", "network": {"id": "521e2a79-be5d-4fa6-8eb8-43b75fdf9d47", "bridge": "br-int", "label": "tempest-TestShelveInstance-1791209952-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.1.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "813af52eb922416fbfc79ce6c132a7d2", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapf6b12a20-28", "ovs_interfaceid": "f6b12a20-2846-4e92-bcbd-958c13c5e899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94111) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Jan 15 02:43:48.985089 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a19eddfa-aa2b-4fc0-adc1-18d960ec6aaf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Releasing lock "refresh_cache-19d658a3-85b8-4130-b672-9843892a6fa5" {{(pid=94111) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Jan 15 02:43:48.986160 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a19eddfa-aa2b-4fc0-adc1-18d960ec6aaf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "POST /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5/action" status: 202 len: 0 microversion: 2.1 time: 3.710851 Jan 15 02:43:48.986730 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 247/464] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:43:45 2021] POST /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5/action => generated 0 bytes in 3712 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jan 15 02:43:49.242122 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1b1d787a-0c57-474c-bfd1-fe3bf3a6d695 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:49.242896 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1b1d787a-0c57-474c-bfd1-fe3bf3a6d695 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 1e1481d5-324e-4893-b3fa-9815f0688933] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:49.255342 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1b1d787a-0c57-474c-bfd1-fe3bf3a6d695 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:49.256268 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1b1d787a-0c57-474c-bfd1-fe3bf3a6d695 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:49.257882 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1b1d787a-0c57-474c-bfd1-fe3bf3a6d695 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:49.258796 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1b1d787a-0c57-474c-bfd1-fe3bf3a6d695 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:49.898160 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1b1d787a-0c57-474c-bfd1-fe3bf3a6d695 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:49.907619 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1b1d787a-0c57-474c-bfd1-fe3bf3a6d695 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933" status: 200 len: 1317 microversion: 2.1 time: 0.676584 Jan 15 02:43:49.908249 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 218/465] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:49 2021] GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933 => generated 1317 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:43:50.933602 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a38c7702-07e2-4394-bca2-22b94dc420ac tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:43:50.934422 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a38c7702-07e2-4394-bca2-22b94dc420ac tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 1e1481d5-324e-4893-b3fa-9815f0688933] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:50.943687 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a38c7702-07e2-4394-bca2-22b94dc420ac tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:50.944199 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a38c7702-07e2-4394-bca2-22b94dc420ac tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:50.945128 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a38c7702-07e2-4394-bca2-22b94dc420ac tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:50.945588 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a38c7702-07e2-4394-bca2-22b94dc420ac tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:51.248063 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a38c7702-07e2-4394-bca2-22b94dc420ac tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:43:51.258157 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a38c7702-07e2-4394-bca2-22b94dc420ac tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933" status: 200 len: 1507 microversion: 2.1 time: 0.335394 Jan 15 02:43:51.258790 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 248/466] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:43:50 2021] GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933 => generated 1507 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:43:55.152491 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4383657b-2b1d-4cd0-b709-ea010dcdb359 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be0fc3ae-1c60-4c10-bdd2-a65e8241ba9d"}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:43:55.153737 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4383657b-2b1d-4cd0-b709-ea010dcdb359 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 1e1481d5-324e-4893-b3fa-9815f0688933] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:43:55.162982 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4383657b-2b1d-4cd0-b709-ea010dcdb359 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:55.163506 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4383657b-2b1d-4cd0-b709-ea010dcdb359 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:55.164363 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4383657b-2b1d-4cd0-b709-ea010dcdb359 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:43:55.164853 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4383657b-2b1d-4cd0-b709-ea010dcdb359 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:43:55.686585 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4383657b-2b1d-4cd0-b709-ea010dcdb359 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "POST /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.544204 Jan 15 02:43:55.687280 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 219/467] 10.222.0.37 () {60 vars in 1313 bytes} [Fri Jan 15 02:43:55 2021] POST /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933/os-volume_attachments => generated 194 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:44:03.530641 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9abda3a4-6700-49e8-94ef-11574b52fce2 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:03.531423 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9abda3a4-6700-49e8-94ef-11574b52fce2 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:03.539780 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9abda3a4-6700-49e8-94ef-11574b52fce2 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:03.540299 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9abda3a4-6700-49e8-94ef-11574b52fce2 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:03.541228 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9abda3a4-6700-49e8-94ef-11574b52fce2 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:03.541738 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9abda3a4-6700-49e8-94ef-11574b52fce2 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:04.182763 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9abda3a4-6700-49e8-94ef-11574b52fce2 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "DELETE /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6/os-volume_attachments/a798a942-3c14-439a-986e-81c95606240b" status: 202 len: 0 microversion: 2.1 time: 0.661875 Jan 15 02:44:04.183455 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 249/468] 10.222.0.37 () {58 vars in 1406 bytes} [Fri Jan 15 02:44:03 2021] DELETE /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6/os-volume_attachments/a798a942-3c14-439a-986e-81c95606240b => generated 0 bytes in 664 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:44:06.689371 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-821e7304-a485-47ed-8020-e252ec3fbb3a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:06.690048 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-821e7304-a485-47ed-8020-e252ec3fbb3a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:06.699300 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-821e7304-a485-47ed-8020-e252ec3fbb3a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:06.699809 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-821e7304-a485-47ed-8020-e252ec3fbb3a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:06.700645 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-821e7304-a485-47ed-8020-e252ec3fbb3a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:06.701190 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-821e7304-a485-47ed-8020-e252ec3fbb3a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:06.779052 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-821e7304-a485-47ed-8020-e252ec3fbb3a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/os-volume_attachments/1025b8fc-e5fb-4098-8975-0c436ec4d456" status: 200 len: 194 microversion: 2.20 time: 0.101082 Jan 15 02:44:06.779736 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 220/469] 10.222.0.37 () {60 vars in 1444 bytes} [Fri Jan 15 02:44:06 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/os-volume_attachments/1025b8fc-e5fb-4098-8975-0c436ec4d456 => generated 194 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:44:06.919841 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a99962fb-bb61-4a50-8d72-29f3ef1ac3fa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:06.920496 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a99962fb-bb61-4a50-8d72-29f3ef1ac3fa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:06.930004 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a99962fb-bb61-4a50-8d72-29f3ef1ac3fa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:06.930510 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a99962fb-bb61-4a50-8d72-29f3ef1ac3fa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:06.931370 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a99962fb-bb61-4a50-8d72-29f3ef1ac3fa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:06.931860 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a99962fb-bb61-4a50-8d72-29f3ef1ac3fa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:07.171619 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6e3ca963-6271-4efd-ba57-26c4ca00e233 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2066699741", "imageRef": "1807a1cb-835d-4a56-8751-82ffa40b12c9", "flavorRef": "452", "networks": [{"uuid": "570f6e31-1bda-4ebb-b8b9-ce9a0b49f0a4"}]}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:07.225508 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a99962fb-bb61-4a50-8d72-29f3ef1ac3fa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "DELETE /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/os-volume_attachments/1025b8fc-e5fb-4098-8975-0c436ec4d456" status: 202 len: 0 microversion: 2.20 time: 0.315069 Jan 15 02:44:07.225709 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 250/470] 10.222.0.37 () {60 vars in 1447 bytes} [Fri Jan 15 02:44:06 2021] DELETE /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa/os-volume_attachments/1025b8fc-e5fb-4098-8975-0c436ec4d456 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 15 02:44:07.559681 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-6e3ca963-6271-4efd-ba57-26c4ca00e233 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] validate_networks() for [('570f6e31-1bda-4ebb-b8b9-ce9a0b49f0a4', None, None, None)] {{(pid=94112) validate_networks /opt/stack/nova/nova/network/neutron.py:2340}} Jan 15 02:44:07.728303 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-85d5717d-2198-4b06-ae52-28f5f04d08a4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:07.728978 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-85d5717d-2198-4b06-ae52-28f5f04d08a4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:07.738839 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-85d5717d-2198-4b06-ae52-28f5f04d08a4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:07.739360 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-85d5717d-2198-4b06-ae52-28f5f04d08a4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:07.740237 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-85d5717d-2198-4b06-ae52-28f5f04d08a4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:07.740740 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-85d5717d-2198-4b06-ae52-28f5f04d08a4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:07.818079 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-85d5717d-2198-4b06-ae52-28f5f04d08a4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Going to try to terminate instance {{(pid=94111) delete /opt/stack/nova/nova/compute/api.py:2535}} Jan 15 02:44:07.953608 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-85d5717d-2198-4b06-ae52-28f5f04d08a4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "DELETE /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 204 len: 0 microversion: 2.1 time: 0.236172 Jan 15 02:44:07.954261 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 251/471] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:44:07 2021] DELETE /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 02:44:07.970066 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-0ddeb822-ed21-47de-a92d-f8518459d88d tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:07.970866 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-0ddeb822-ed21-47de-a92d-f8518459d88d tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:07.980185 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0ddeb822-ed21-47de-a92d-f8518459d88d tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:07.980705 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0ddeb822-ed21-47de-a92d-f8518459d88d tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:07.981670 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0ddeb822-ed21-47de-a92d-f8518459d88d tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:07.982167 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0ddeb822-ed21-47de-a92d-f8518459d88d tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:08.220219 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-6e3ca963-6271-4efd-ba57-26c4ca00e233 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Flavor limits 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 02:44:08.221641 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-6e3ca963-6271-4efd-ba57-26c4ca00e233 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Image limits 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Jan 15 02:44:08.223400 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-6e3ca963-6271-4efd-ba57-26c4ca00e233 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Flavor pref 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 02:44:08.224507 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-6e3ca963-6271-4efd-ba57-26c4ca00e233 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Image pref 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Jan 15 02:44:08.225405 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-6e3ca963-6271-4efd-ba57-26c4ca00e233 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Jan 15 02:44:08.242218 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6e3ca963-6271-4efd-ba57-26c4ca00e233 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:08.243151 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6e3ca963-6271-4efd-ba57-26c4ca00e233 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:08.244806 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6e3ca963-6271-4efd-ba57-26c4ca00e233 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:08.245754 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6e3ca963-6271-4efd-ba57-26c4ca00e233 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:08.273373 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0ddeb822-ed21-47de-a92d-f8518459d88d tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:08.284159 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-6e3ca963-6271-4efd-ba57-26c4ca00e233 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Getting quotas for project dd56ed8011104bf0a99ad88d8911ead9. Resources: {'ram', 'instances', 'cores'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:44:08.292003 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-0ddeb822-ed21-47de-a92d-f8518459d88d tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 200 len: 1513 microversion: 2.1 time: 0.331346 Jan 15 02:44:08.305039 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 252/472] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:07 2021] GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 1513 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:44:08.305753 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-6e3ca963-6271-4efd-ba57-26c4ca00e233 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Getting quotas for user 63160ec41a3b4c9e839a6aefe3c269d0 and project dd56ed8011104bf0a99ad88d8911ead9. Resources: {'ram', 'instances', 'cores'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:44:08.311500 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6e3ca963-6271-4efd-ba57-26c4ca00e233 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Going to run 1 instances... {{(pid=94112) _provision_instances /opt/stack/nova/nova/compute/api.py:1263}} Jan 15 02:44:08.314256 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6e3ca963-6271-4efd-ba57-26c4ca00e233 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: adecaebf-3bf6-4dab-a332-5ff4fda684bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1807a1cb-835d-4a56-8751-82ffa40b12c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94112) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1661}} Jan 15 02:44:08.374940 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6e3ca963-6271-4efd-ba57-26c4ca00e233 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.217076 Jan 15 02:44:08.383626 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 221/473] 10.222.0.37 () {60 vars in 1137 bytes} [Fri Jan 15 02:44:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 15 02:44:08.399264 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-bb653613-f6aa-4950-81d5-eab415137825 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:08.400223 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-bb653613-f6aa-4950-81d5-eab415137825 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: adecaebf-3bf6-4dab-a332-5ff4fda684bb] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:08.518434 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-bb653613-f6aa-4950-81d5-eab415137825 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:08.528099 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-bb653613-f6aa-4950-81d5-eab415137825 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb" status: 200 len: 1218 microversion: 2.1 time: 0.140353 Jan 15 02:44:08.528852 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 253/474] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:08 2021] GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb => generated 1218 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:44:09.327700 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-948f18bb-1b5a-4345-9d20-d4c8f0d78cd8 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:09.328264 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-948f18bb-1b5a-4345-9d20-d4c8f0d78cd8 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:09.338513 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-948f18bb-1b5a-4345-9d20-d4c8f0d78cd8 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:09.339023 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-948f18bb-1b5a-4345-9d20-d4c8f0d78cd8 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:09.339941 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-948f18bb-1b5a-4345-9d20-d4c8f0d78cd8 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:09.340428 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-948f18bb-1b5a-4345-9d20-d4c8f0d78cd8 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:09.553198 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2820b851-051e-4ded-b597-9879059ebb94 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:09.553885 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2820b851-051e-4ded-b597-9879059ebb94 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: adecaebf-3bf6-4dab-a332-5ff4fda684bb] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:09.562135 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2820b851-051e-4ded-b597-9879059ebb94 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:09.562664 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2820b851-051e-4ded-b597-9879059ebb94 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:09.563519 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2820b851-051e-4ded-b597-9879059ebb94 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:09.564001 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2820b851-051e-4ded-b597-9879059ebb94 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:09.600306 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-948f18bb-1b5a-4345-9d20-d4c8f0d78cd8 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:09.611322 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-948f18bb-1b5a-4345-9d20-d4c8f0d78cd8 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 200 len: 1513 microversion: 2.1 time: 0.293087 Jan 15 02:44:09.612572 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 222/475] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:09 2021] GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 1513 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:09.622713 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-407d0176-4035-46c1-98be-0f2bbab4a3f4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:09.623264 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-407d0176-4035-46c1-98be-0f2bbab4a3f4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:09.632261 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-407d0176-4035-46c1-98be-0f2bbab4a3f4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:09.632774 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-407d0176-4035-46c1-98be-0f2bbab4a3f4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:09.633678 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-407d0176-4035-46c1-98be-0f2bbab4a3f4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:09.634175 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-407d0176-4035-46c1-98be-0f2bbab4a3f4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:09.717404 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-407d0176-4035-46c1-98be-0f2bbab4a3f4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Going to try to terminate instance {{(pid=94112) delete /opt/stack/nova/nova/compute/api.py:2535}} Jan 15 02:44:09.717638 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-2820b851-051e-4ded-b597-9879059ebb94 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:09.727170 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2820b851-051e-4ded-b597-9879059ebb94 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb" status: 200 len: 1270 microversion: 2.1 time: 0.184240 Jan 15 02:44:09.733325 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 254/476] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:09 2021] GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb => generated 1270 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:44:09.843257 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-407d0176-4035-46c1-98be-0f2bbab4a3f4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "DELETE /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 204 len: 0 microversion: 2.20 time: 0.228985 Jan 15 02:44:09.844045 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 223/477] 10.222.0.37 () {60 vars in 1270 bytes} [Fri Jan 15 02:44:09 2021] DELETE /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 02:44:09.858904 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-982b05a7-bb84-44c3-9c28-aa7335548a73 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:09.859570 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-982b05a7-bb84-44c3-9c28-aa7335548a73 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:09.867696 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-982b05a7-bb84-44c3-9c28-aa7335548a73 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:09.868202 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-982b05a7-bb84-44c3-9c28-aa7335548a73 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:09.869076 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-982b05a7-bb84-44c3-9c28-aa7335548a73 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:09.869569 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-982b05a7-bb84-44c3-9c28-aa7335548a73 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:10.269143 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-982b05a7-bb84-44c3-9c28-aa7335548a73 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:10.286093 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-982b05a7-bb84-44c3-9c28-aa7335548a73 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:10.292950 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-982b05a7-bb84-44c3-9c28-aa7335548a73 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:10.294228 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-982b05a7-bb84-44c3-9c28-aa7335548a73 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1725 microversion: 2.20 time: 0.444590 Jan 15 02:44:10.294814 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 255/478] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:44:09 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1725 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:44:10.661606 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b1f80098-35bf-458d-9474-b76b84fcf63c tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:10.663171 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b1f80098-35bf-458d-9474-b76b84fcf63c tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:10.671138 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b1f80098-35bf-458d-9474-b76b84fcf63c tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:10.671853 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b1f80098-35bf-458d-9474-b76b84fcf63c tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:10.673186 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b1f80098-35bf-458d-9474-b76b84fcf63c tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:10.673923 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b1f80098-35bf-458d-9474-b76b84fcf63c tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:10.751793 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e35f2740-04ee-4682-ad42-10094256e15c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:10.753602 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e35f2740-04ee-4682-ad42-10094256e15c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: adecaebf-3bf6-4dab-a332-5ff4fda684bb] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:10.762081 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e35f2740-04ee-4682-ad42-10094256e15c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:10.762927 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e35f2740-04ee-4682-ad42-10094256e15c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:10.764080 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e35f2740-04ee-4682-ad42-10094256e15c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:10.764588 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e35f2740-04ee-4682-ad42-10094256e15c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:10.960324 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e35f2740-04ee-4682-ad42-10094256e15c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:10.970302 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e35f2740-04ee-4682-ad42-10094256e15c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb" status: 200 len: 1276 microversion: 2.1 time: 0.227711 Jan 15 02:44:10.971574 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 256/479] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:10 2021] GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb => generated 1276 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:11.074237 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b1f80098-35bf-458d-9474-b76b84fcf63c tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:11.091980 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b1f80098-35bf-458d-9474-b76b84fcf63c tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 200 len: 1513 microversion: 2.1 time: 0.464268 Jan 15 02:44:11.092970 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 224/480] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:10 2021] GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 1513 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:11.331983 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-87af60a0-bdb8-4f5f-8385-04bdb5a56a17 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:11.333053 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-87af60a0-bdb8-4f5f-8385-04bdb5a56a17 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:11.342427 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-87af60a0-bdb8-4f5f-8385-04bdb5a56a17 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:11.343315 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-87af60a0-bdb8-4f5f-8385-04bdb5a56a17 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:11.344406 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-87af60a0-bdb8-4f5f-8385-04bdb5a56a17 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:11.345141 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-87af60a0-bdb8-4f5f-8385-04bdb5a56a17 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:11.847332 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-707c151c-2def-4b0f-a4e6-11cace642e70 req-db63221b-663a-4a7e-994d-51716d42daa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c7655c8-a23b-450e-860e-ca0419dfd7b6", "name": "network-vif-deleted", "tag": "0700ea1e-d416-4d37-a2d2-b3cb2eca7bfa"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:11.855156 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:44:11.855156 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:44:11.871807 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-707c151c-2def-4b0f-a4e6-11cace642e70 req-db63221b-663a-4a7e-994d-51716d42daa7 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:11.873360 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-707c151c-2def-4b0f-a4e6-11cace642e70 req-db63221b-663a-4a7e-994d-51716d42daa7 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:11.907560 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-87af60a0-bdb8-4f5f-8385-04bdb5a56a17 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:11.926776 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-707c151c-2def-4b0f-a4e6-11cace642e70 req-db63221b-663a-4a7e-994d-51716d42daa7 service nova] Creating event network-vif-deleted:0700ea1e-d416-4d37-a2d2-b3cb2eca7bfa for instance 3c7655c8-a23b-450e-860e-ca0419dfd7b6 on hv-cinder-76330 Jan 15 02:44:11.934302 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-87af60a0-bdb8-4f5f-8385-04bdb5a56a17 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:11.937588 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-707c151c-2def-4b0f-a4e6-11cace642e70 req-db63221b-663a-4a7e-994d-51716d42daa7 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101642 Jan 15 02:44:11.939082 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 225/481] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:44:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:44:11.942894 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-87af60a0-bdb8-4f5f-8385-04bdb5a56a17 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:11.944381 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-87af60a0-bdb8-4f5f-8385-04bdb5a56a17 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1725 microversion: 2.20 time: 0.631512 Jan 15 02:44:11.945505 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 257/482] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:44:11 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1725 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:44:11.997573 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-19d7aa5b-1b17-4eac-94b8-db7b67f17094 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:11.998407 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-19d7aa5b-1b17-4eac-94b8-db7b67f17094 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: adecaebf-3bf6-4dab-a332-5ff4fda684bb] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:12.015317 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-19d7aa5b-1b17-4eac-94b8-db7b67f17094 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:12.016480 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-19d7aa5b-1b17-4eac-94b8-db7b67f17094 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:12.018317 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-19d7aa5b-1b17-4eac-94b8-db7b67f17094 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:12.019251 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-19d7aa5b-1b17-4eac-94b8-db7b67f17094 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:12.117231 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ec59b958-32dd-48ee-a97c-1f7407d4aaa4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:12.117804 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ec59b958-32dd-48ee-a97c-1f7407d4aaa4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:12.126147 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ec59b958-32dd-48ee-a97c-1f7407d4aaa4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:12.126657 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ec59b958-32dd-48ee-a97c-1f7407d4aaa4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:12.129039 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ec59b958-32dd-48ee-a97c-1f7407d4aaa4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:12.129592 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ec59b958-32dd-48ee-a97c-1f7407d4aaa4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:12.227967 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ec59b958-32dd-48ee-a97c-1f7407d4aaa4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:12.228471 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ec59b958-32dd-48ee-a97c-1f7407d4aaa4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:12.228984 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.objects.instance [None req-ec59b958-32dd-48ee-a97c-1f7407d4aaa4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lazy-loading 'fault' on Instance uuid 3c7655c8-a23b-450e-860e-ca0419dfd7b6 {{(pid=94111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Jan 15 02:44:12.333805 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-ec59b958-32dd-48ee-a97c-1f7407d4aaa4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:12.343247 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ec59b958-32dd-48ee-a97c-1f7407d4aaa4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 200 len: 1308 microversion: 2.1 time: 0.235922 Jan 15 02:44:12.343898 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 258/483] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:12 2021] GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 1308 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:12.979596 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a75e4836-81fd-4bee-a5c8-4fd91e594a5d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:12.981999 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a75e4836-81fd-4bee-a5c8-4fd91e594a5d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:12.998679 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a75e4836-81fd-4bee-a5c8-4fd91e594a5d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:12.999977 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a75e4836-81fd-4bee-a5c8-4fd91e594a5d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:13.002885 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a75e4836-81fd-4bee-a5c8-4fd91e594a5d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:13.004214 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a75e4836-81fd-4bee-a5c8-4fd91e594a5d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:13.164646 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-19d7aa5b-1b17-4eac-94b8-db7b67f17094 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:13.177491 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-19d7aa5b-1b17-4eac-94b8-db7b67f17094 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb" status: 200 len: 1318 microversion: 2.1 time: 1.189808 Jan 15 02:44:13.178096 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 226/484] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:11 2021] GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb => generated 1318 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:44:13.379815 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6cfa75ca-d8a0-4b89-ac87-05d0e04cceaf tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:13.381517 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6cfa75ca-d8a0-4b89-ac87-05d0e04cceaf tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 3c7655c8-a23b-450e-860e-ca0419dfd7b6] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:13.398208 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6cfa75ca-d8a0-4b89-ac87-05d0e04cceaf tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:13.399573 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6cfa75ca-d8a0-4b89-ac87-05d0e04cceaf tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:13.401458 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6cfa75ca-d8a0-4b89-ac87-05d0e04cceaf tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:13.402817 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6cfa75ca-d8a0-4b89-ac87-05d0e04cceaf tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:13.534523 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-6cfa75ca-d8a0-4b89-ac87-05d0e04cceaf tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] HTTP exception thrown: Instance 3c7655c8-a23b-450e-860e-ca0419dfd7b6 could not be found. Jan 15 02:44:13.536122 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6cfa75ca-d8a0-4b89-ac87-05d0e04cceaf tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Returning 404 to user: Instance 3c7655c8-a23b-450e-860e-ca0419dfd7b6 could not be found. {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:44:13.537860 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6cfa75ca-d8a0-4b89-ac87-05d0e04cceaf tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6" status: 404 len: 111 microversion: 2.1 time: 0.178550 Jan 15 02:44:13.539289 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 227/485] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:13 2021] GET /compute/v2.1/servers/3c7655c8-a23b-450e-860e-ca0419dfd7b6 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:44:13.572696 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-277aafee-166b-4bd1-a52f-d75b96bb5814 req-9349e2ca-da53-4d80-a14f-118fedd21b34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adecaebf-3bf6-4dab-a332-5ff4fda684bb", "tag": "51517f2a-fb1a-48a0-99d4-4b4cdfb90916"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:13.588594 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:44:13.588594 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:44:13.616077 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-277aafee-166b-4bd1-a52f-d75b96bb5814 req-9349e2ca-da53-4d80-a14f-118fedd21b34 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:13.617441 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-277aafee-166b-4bd1-a52f-d75b96bb5814 req-9349e2ca-da53-4d80-a14f-118fedd21b34 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:13.643738 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a75e4836-81fd-4bee-a5c8-4fd91e594a5d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:13.655482 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-277aafee-166b-4bd1-a52f-d75b96bb5814 req-9349e2ca-da53-4d80-a14f-118fedd21b34 service nova] Creating event network-changed:51517f2a-fb1a-48a0-99d4-4b4cdfb90916 for instance adecaebf-3bf6-4dab-a332-5ff4fda684bb on hv-cinder-76330 Jan 15 02:44:13.667976 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-277aafee-166b-4bd1-a52f-d75b96bb5814 req-9349e2ca-da53-4d80-a14f-118fedd21b34 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108177 Jan 15 02:44:13.669119 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 228/486] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:44:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:44:13.687837 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a75e4836-81fd-4bee-a5c8-4fd91e594a5d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:13.713971 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a75e4836-81fd-4bee-a5c8-4fd91e594a5d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:13.724160 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a75e4836-81fd-4bee-a5c8-4fd91e594a5d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1725 microversion: 2.20 time: 0.762611 Jan 15 02:44:13.726526 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 259/487] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:44:12 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1725 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:44:14.217968 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2d1321ea-e01f-4c02-9cc4-27c240ed0df0 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:14.220680 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2d1321ea-e01f-4c02-9cc4-27c240ed0df0 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: adecaebf-3bf6-4dab-a332-5ff4fda684bb] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:14.238865 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2d1321ea-e01f-4c02-9cc4-27c240ed0df0 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:14.240291 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2d1321ea-e01f-4c02-9cc4-27c240ed0df0 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:14.242828 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2d1321ea-e01f-4c02-9cc4-27c240ed0df0 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:14.244045 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2d1321ea-e01f-4c02-9cc4-27c240ed0df0 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:14.634824 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-2d1321ea-e01f-4c02-9cc4-27c240ed0df0 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:14.645965 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2d1321ea-e01f-4c02-9cc4-27c240ed0df0 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb" status: 200 len: 1318 microversion: 2.1 time: 0.450925 Jan 15 02:44:14.646964 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 229/488] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:14 2021] GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:14.764163 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5f2574cc-198d-40dd-8496-1d430480a9d6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:14.765438 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5f2574cc-198d-40dd-8496-1d430480a9d6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:14.784698 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5f2574cc-198d-40dd-8496-1d430480a9d6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:14.785276 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5f2574cc-198d-40dd-8496-1d430480a9d6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:14.786166 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5f2574cc-198d-40dd-8496-1d430480a9d6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:14.786679 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5f2574cc-198d-40dd-8496-1d430480a9d6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:14.859279 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-f39f4b7d-5047-4d14-a98a-3f0aa6ad6b57 req-8bc455d7-dc35-4cc7-9196-18812bb9a8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a86e56-4ee0-4098-98bb-7deac49ba1aa", "name": "network-vif-deleted", "tag": "a3bc182a-ab0e-4f1a-9e0f-958740ed4222"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:14.870707 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:44:14.870707 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:44:14.881088 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-f39f4b7d-5047-4d14-a98a-3f0aa6ad6b57 req-8bc455d7-dc35-4cc7-9196-18812bb9a8f2 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:14.882304 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-f39f4b7d-5047-4d14-a98a-3f0aa6ad6b57 req-8bc455d7-dc35-4cc7-9196-18812bb9a8f2 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:14.907011 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-f39f4b7d-5047-4d14-a98a-3f0aa6ad6b57 req-8bc455d7-dc35-4cc7-9196-18812bb9a8f2 service nova] Creating event network-vif-deleted:a3bc182a-ab0e-4f1a-9e0f-958740ed4222 for instance a8a86e56-4ee0-4098-98bb-7deac49ba1aa on hv-cinder-76330 Jan 15 02:44:14.914080 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-f39f4b7d-5047-4d14-a98a-3f0aa6ad6b57 req-8bc455d7-dc35-4cc7-9196-18812bb9a8f2 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063942 Jan 15 02:44:14.915071 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 230/489] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:44:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:44:14.967190 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-5f2574cc-198d-40dd-8496-1d430480a9d6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:14.988623 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-5f2574cc-198d-40dd-8496-1d430480a9d6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:14.998124 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-5f2574cc-198d-40dd-8496-1d430480a9d6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:14.999386 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5f2574cc-198d-40dd-8496-1d430480a9d6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1658 microversion: 2.20 time: 0.255367 Jan 15 02:44:15.000058 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 260/490] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:44:14 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1658 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:44:15.672490 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-19fa23f4-d66a-4e8f-9356-d0ef697b9c1a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:15.677589 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-19fa23f4-d66a-4e8f-9356-d0ef697b9c1a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: adecaebf-3bf6-4dab-a332-5ff4fda684bb] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:15.693046 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-19fa23f4-d66a-4e8f-9356-d0ef697b9c1a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:15.693935 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-19fa23f4-d66a-4e8f-9356-d0ef697b9c1a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:15.694925 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-19fa23f4-d66a-4e8f-9356-d0ef697b9c1a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:15.695554 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-19fa23f4-d66a-4e8f-9356-d0ef697b9c1a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:16.026431 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c73ee3f5-0552-46cf-ba32-6804b2e87f4a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:16.027005 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-19fa23f4-d66a-4e8f-9356-d0ef697b9c1a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:16.027155 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c73ee3f5-0552-46cf-ba32-6804b2e87f4a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:16.040181 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c73ee3f5-0552-46cf-ba32-6804b2e87f4a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:16.040695 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c73ee3f5-0552-46cf-ba32-6804b2e87f4a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:16.042255 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c73ee3f5-0552-46cf-ba32-6804b2e87f4a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:16.042530 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c73ee3f5-0552-46cf-ba32-6804b2e87f4a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:16.045549 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-19fa23f4-d66a-4e8f-9356-d0ef697b9c1a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb" status: 200 len: 1318 microversion: 2.1 time: 0.383659 Jan 15 02:44:16.048416 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 231/491] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:15 2021] GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:16.115030 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a016b85f-c783-49a4-a279-d0e0832e6651 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:16.119977 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a016b85f-c783-49a4-a279-d0e0832e6651 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:16.125720 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a016b85f-c783-49a4-a279-d0e0832e6651 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:16.126240 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a016b85f-c783-49a4-a279-d0e0832e6651 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:16.127827 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a016b85f-c783-49a4-a279-d0e0832e6651 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:16.128330 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a016b85f-c783-49a4-a279-d0e0832e6651 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:16.190983 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c73ee3f5-0552-46cf-ba32-6804b2e87f4a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:16.206901 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c73ee3f5-0552-46cf-ba32-6804b2e87f4a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:16.218731 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c73ee3f5-0552-46cf-ba32-6804b2e87f4a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:16.220057 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c73ee3f5-0552-46cf-ba32-6804b2e87f4a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1658 microversion: 2.20 time: 0.204455 Jan 15 02:44:16.232566 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 261/492] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:44:16 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1658 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:44:16.494580 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a016b85f-c783-49a4-a279-d0e0832e6651 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "DELETE /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/os-volume_attachments/fb875f13-e2ea-41e6-a714-d42708396ce6" status: 202 len: 0 microversion: 2.1 time: 0.389439 Jan 15 02:44:16.495664 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 232/493] 10.222.0.37 () {58 vars in 1406 bytes} [Fri Jan 15 02:44:16 2021] DELETE /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/os-volume_attachments/fb875f13-e2ea-41e6-a714-d42708396ce6 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 02:44:17.072870 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7465a201-8182-4e5d-ab43-247a1f5a3916 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:17.073587 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-7465a201-8182-4e5d-ab43-247a1f5a3916 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: adecaebf-3bf6-4dab-a332-5ff4fda684bb] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:17.082465 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7465a201-8182-4e5d-ab43-247a1f5a3916 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:17.082974 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7465a201-8182-4e5d-ab43-247a1f5a3916 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:17.083833 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7465a201-8182-4e5d-ab43-247a1f5a3916 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:17.084338 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7465a201-8182-4e5d-ab43-247a1f5a3916 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:17.247555 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-0fc213a7-e2f9-4b26-b401-cc48b754418a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:17.248755 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-0fc213a7-e2f9-4b26-b401-cc48b754418a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:17.260445 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0fc213a7-e2f9-4b26-b401-cc48b754418a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:17.261197 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0fc213a7-e2f9-4b26-b401-cc48b754418a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:17.262495 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0fc213a7-e2f9-4b26-b401-cc48b754418a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:17.263201 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0fc213a7-e2f9-4b26-b401-cc48b754418a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:17.357983 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0fc213a7-e2f9-4b26-b401-cc48b754418a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:17.358494 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0fc213a7-e2f9-4b26-b401-cc48b754418a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:17.359003 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.objects.instance [None req-0fc213a7-e2f9-4b26-b401-cc48b754418a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lazy-loading 'fault' on Instance uuid a8a86e56-4ee0-4098-98bb-7deac49ba1aa {{(pid=94112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Jan 15 02:44:17.428652 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0fc213a7-e2f9-4b26-b401-cc48b754418a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:17.445399 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0fc213a7-e2f9-4b26-b401-cc48b754418a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:17.452147 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0fc213a7-e2f9-4b26-b401-cc48b754418a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:17.453414 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-0fc213a7-e2f9-4b26-b401-cc48b754418a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 200 len: 1372 microversion: 2.20 time: 0.218179 Jan 15 02:44:17.454011 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 233/494] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:44:17 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:44:17.493640 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-7465a201-8182-4e5d-ab43-247a1f5a3916 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:17.503862 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-7465a201-8182-4e5d-ab43-247a1f5a3916 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb" status: 200 len: 1318 microversion: 2.1 time: 0.443457 Jan 15 02:44:17.504490 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 262/495] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:17 2021] GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb => generated 1318 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:18.484019 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-248893d2-040e-4c0e-8f84-b3fbd2046029 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:18.484019 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-248893d2-040e-4c0e-8f84-b3fbd2046029 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:18.491267 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-248893d2-040e-4c0e-8f84-b3fbd2046029 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:18.491782 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-248893d2-040e-4c0e-8f84-b3fbd2046029 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:18.492762 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-248893d2-040e-4c0e-8f84-b3fbd2046029 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:18.493485 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-248893d2-040e-4c0e-8f84-b3fbd2046029 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:18.527842 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-935aad5c-e262-4f33-9886-e620f13ba46a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:18.528504 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-935aad5c-e262-4f33-9886-e620f13ba46a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: adecaebf-3bf6-4dab-a332-5ff4fda684bb] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:18.537281 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-935aad5c-e262-4f33-9886-e620f13ba46a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:18.537807 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-935aad5c-e262-4f33-9886-e620f13ba46a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:18.538709 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-935aad5c-e262-4f33-9886-e620f13ba46a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:18.539205 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-935aad5c-e262-4f33-9886-e620f13ba46a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:18.549846 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-248893d2-040e-4c0e-8f84-b3fbd2046029 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] HTTP exception thrown: Instance a8a86e56-4ee0-4098-98bb-7deac49ba1aa could not be found. Jan 15 02:44:18.550514 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-248893d2-040e-4c0e-8f84-b3fbd2046029 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Returning 404 to user: Instance a8a86e56-4ee0-4098-98bb-7deac49ba1aa could not be found. {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:44:18.551424 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-248893d2-040e-4c0e-8f84-b3fbd2046029 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 404 len: 111 microversion: 2.20 time: 0.080785 Jan 15 02:44:18.555787 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 234/496] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:44:18 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 02:44:18.566678 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-38d2cdf0-4027-4e97-860b-09e9fe72fba8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '.version_select at 0x7f8793c306a8>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:18.591344 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-38d2cdf0-4027-4e97-860b-09e9fe72fba8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631292761" status: 204 len: 0 microversion: 2.20 time: 0.034265 Jan 15 02:44:18.592104 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 235/497] 10.222.0.37 () {60 vars in 1252 bytes} [Fri Jan 15 02:44:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631292761 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 02:44:18.833167 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5c6b5002-f32b-43cc-90e3-0109080077c4 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:18.841241 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5c6b5002-f32b-43cc-90e3-0109080077c4 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:18.841752 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5c6b5002-f32b-43cc-90e3-0109080077c4 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:18.901135 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-935aad5c-e262-4f33-9886-e620f13ba46a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:18.911104 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5c6b5002-f32b-43cc-90e3-0109080077c4 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Going to try to stop instance {{(pid=94112) force_stop /opt/stack/nova/nova/compute/api.py:2575}} Jan 15 02:44:18.911232 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-935aad5c-e262-4f33-9886-e620f13ba46a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb" status: 200 len: 1318 microversion: 2.1 time: 0.393062 Jan 15 02:44:18.911772 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 263/498] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:18 2021] GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:18.998319 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5c6b5002-f32b-43cc-90e3-0109080077c4 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 202 len: 0 microversion: 2.1 time: 0.174881 Jan 15 02:44:18.998937 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 236/499] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:44:18 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:44:19.014387 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a95655a3-4beb-4618-b650-03942d797165 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:19.015362 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a95655a3-4beb-4618-b650-03942d797165 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:19.026121 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a95655a3-4beb-4618-b650-03942d797165 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:19.026636 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a95655a3-4beb-4618-b650-03942d797165 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:19.027490 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a95655a3-4beb-4618-b650-03942d797165 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:19.027985 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a95655a3-4beb-4618-b650-03942d797165 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:19.531580 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a95655a3-4beb-4618-b650-03942d797165 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:19.541925 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a95655a3-4beb-4618-b650-03942d797165 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1679 microversion: 2.1 time: 0.536931 Jan 15 02:44:19.542645 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 264/500] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:19 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1679 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:19.936821 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a6470c4c-0db3-4ab6-bf2a-9a66e9c34cf4 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:19.937637 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a6470c4c-0db3-4ab6-bf2a-9a66e9c34cf4 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: adecaebf-3bf6-4dab-a332-5ff4fda684bb] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:19.947583 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a6470c4c-0db3-4ab6-bf2a-9a66e9c34cf4 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:19.948098 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a6470c4c-0db3-4ab6-bf2a-9a66e9c34cf4 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:19.948964 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a6470c4c-0db3-4ab6-bf2a-9a66e9c34cf4 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:19.949496 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a6470c4c-0db3-4ab6-bf2a-9a66e9c34cf4 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:20.071186 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c0f3f7e1-3b9e-4003-bf1b-fa188ae47e89 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'create', calling method: .version_select at 0x7f878e76bd90>, body: {"keypair": {"name": "tempest-keypair-777976179"}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:20.102426 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-c0f3f7e1-3b9e-4003-bf1b-fa188ae47e89 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Getting quotas for project a4201fdfaa594ca28ac9f59debb11e2a. Resources: {'key_pairs'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:44:20.106835 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-c0f3f7e1-3b9e-4003-bf1b-fa188ae47e89 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Getting quotas for user 9698bc5c912a4f86a7f0961c3cd41364 and project a4201fdfaa594ca28ac9f59debb11e2a. Resources: {'key_pairs'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:44:20.215010 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a6470c4c-0db3-4ab6-bf2a-9a66e9c34cf4 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:20.224763 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a6470c4c-0db3-4ab6-bf2a-9a66e9c34cf4 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb" status: 200 len: 1318 microversion: 2.1 time: 0.297900 Jan 15 02:44:20.225444 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 237/501] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:19 2021] GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:44:20.569091 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-987c150b-8b81-46ec-b1fd-56684804b0ea tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:20.570156 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-987c150b-8b81-46ec-b1fd-56684804b0ea tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:20.584852 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-987c150b-8b81-46ec-b1fd-56684804b0ea tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:20.585741 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-987c150b-8b81-46ec-b1fd-56684804b0ea tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:20.587168 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-987c150b-8b81-46ec-b1fd-56684804b0ea tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:20.587894 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-987c150b-8b81-46ec-b1fd-56684804b0ea tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:20.603968 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-c0f3f7e1-3b9e-4003-bf1b-fa188ae47e89 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Getting quotas for project a4201fdfaa594ca28ac9f59debb11e2a. Resources: {'key_pairs'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:44:20.611094 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-c0f3f7e1-3b9e-4003-bf1b-fa188ae47e89 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Getting quotas for user 9698bc5c912a4f86a7f0961c3cd41364 and project a4201fdfaa594ca28ac9f59debb11e2a. Resources: {'key_pairs'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:44:20.635550 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c0f3f7e1-3b9e-4003-bf1b-fa188ae47e89 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.574420 Jan 15 02:44:20.637179 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 265/502] 10.222.0.37 () {62 vars in 1189 bytes} [Fri Jan 15 02:44:20 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 577 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jan 15 02:44:20.926955 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-987c150b-8b81-46ec-b1fd-56684804b0ea tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:20.936146 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-987c150b-8b81-46ec-b1fd-56684804b0ea tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1679 microversion: 2.1 time: 0.379061 Jan 15 02:44:20.936742 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 238/503] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:20 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1679 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:44:21.250042 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-25d55870-3d0d-444f-868f-3b4d26828937 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:21.250804 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-25d55870-3d0d-444f-868f-3b4d26828937 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: adecaebf-3bf6-4dab-a332-5ff4fda684bb] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:21.259624 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-25d55870-3d0d-444f-868f-3b4d26828937 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:21.260146 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-25d55870-3d0d-444f-868f-3b4d26828937 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:21.261034 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-25d55870-3d0d-444f-868f-3b4d26828937 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:21.261601 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-25d55870-3d0d-444f-868f-3b4d26828937 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:21.647382 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-25d55870-3d0d-444f-868f-3b4d26828937 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:21.656671 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-25d55870-3d0d-444f-868f-3b4d26828937 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb" status: 200 len: 1318 microversion: 2.1 time: 0.416170 Jan 15 02:44:21.658141 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 266/504] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:21 2021] GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:21.962568 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1e1263ff-db47-415a-9b8f-aec48750c4b8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:21.963250 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1e1263ff-db47-415a-9b8f-aec48750c4b8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:21.972577 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1e1263ff-db47-415a-9b8f-aec48750c4b8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:21.973132 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1e1263ff-db47-415a-9b8f-aec48750c4b8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:21.973995 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1e1263ff-db47-415a-9b8f-aec48750c4b8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:21.974554 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1e1263ff-db47-415a-9b8f-aec48750c4b8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:22.236359 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1e1263ff-db47-415a-9b8f-aec48750c4b8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:22.246991 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1e1263ff-db47-415a-9b8f-aec48750c4b8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1679 microversion: 2.1 time: 0.294919 Jan 15 02:44:22.247623 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 239/505] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:21 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1679 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:22.682399 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a4fc033c-06e5-4838-92a2-1275f0426894 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:22.683082 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a4fc033c-06e5-4838-92a2-1275f0426894 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: adecaebf-3bf6-4dab-a332-5ff4fda684bb] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:22.693039 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a4fc033c-06e5-4838-92a2-1275f0426894 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:22.693582 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a4fc033c-06e5-4838-92a2-1275f0426894 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:22.694449 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a4fc033c-06e5-4838-92a2-1275f0426894 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:22.694949 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a4fc033c-06e5-4838-92a2-1275f0426894 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:23.152139 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3551f2d1-9998-4443-9701-f96bbb0a60d9 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-553927187", "imageRef": "1807a1cb-835d-4a56-8751-82ffa40b12c9", "flavorRef": "452", "networks": [{"uuid": "1ca677c7-2a66-4fff-b537-accd652409a8"}]}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:23.166285 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a4fc033c-06e5-4838-92a2-1275f0426894 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:23.180016 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a4fc033c-06e5-4838-92a2-1275f0426894 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb" status: 200 len: 1318 microversion: 2.1 time: 0.507688 Jan 15 02:44:23.181310 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 267/506] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:22 2021] GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:23.274706 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d0875b84-421f-495c-bb61-55ef525a9829 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:23.276330 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d0875b84-421f-495c-bb61-55ef525a9829 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:23.293718 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d0875b84-421f-495c-bb61-55ef525a9829 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:23.295141 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d0875b84-421f-495c-bb61-55ef525a9829 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:23.297073 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d0875b84-421f-495c-bb61-55ef525a9829 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:23.298299 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d0875b84-421f-495c-bb61-55ef525a9829 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:23.336499 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-3551f2d1-9998-4443-9701-f96bbb0a60d9 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] validate_networks() for [('1ca677c7-2a66-4fff-b537-accd652409a8', None, None, None)] {{(pid=94112) validate_networks /opt/stack/nova/nova/network/neutron.py:2340}} Jan 15 02:44:23.663151 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d0875b84-421f-495c-bb61-55ef525a9829 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:23.672486 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d0875b84-421f-495c-bb61-55ef525a9829 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1679 microversion: 2.1 time: 0.410261 Jan 15 02:44:23.673110 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 268/507] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:23 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1679 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:44:23.685185 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-5c26503e-9ae3-486e-a431-61b62436545d req-4f3a748c-261d-4d93-9f39-23aef40908c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adecaebf-3bf6-4dab-a332-5ff4fda684bb", "name": "network-vif-plugged", "status": "completed", "tag": "51517f2a-fb1a-48a0-99d4-4b4cdfb90916"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:23.692777 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:44:23.692777 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:44:23.703992 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-5c26503e-9ae3-486e-a431-61b62436545d req-4f3a748c-261d-4d93-9f39-23aef40908c5 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:23.704490 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-5c26503e-9ae3-486e-a431-61b62436545d req-4f3a748c-261d-4d93-9f39-23aef40908c5 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:23.724572 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-5c26503e-9ae3-486e-a431-61b62436545d req-4f3a748c-261d-4d93-9f39-23aef40908c5 service nova] Creating event network-vif-plugged:51517f2a-fb1a-48a0-99d4-4b4cdfb90916 for instance adecaebf-3bf6-4dab-a332-5ff4fda684bb on hv-cinder-76330 Jan 15 02:44:23.730009 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-5c26503e-9ae3-486e-a431-61b62436545d req-4f3a748c-261d-4d93-9f39-23aef40908c5 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055289 Jan 15 02:44:23.730650 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 269/508] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:44:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:44:23.743441 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d8d76bfb-707b-4471-92cf-2cf38c7ce955 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1968265208", "imageRef": "1807a1cb-835d-4a56-8751-82ffa40b12c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64576b11-ff23-432d-a6d4-0c0a0fbf857f"}], "security_groups": [{"name": "tempest-securitygroup--1437174008"}], "key_name": "tempest-keypair-777976179", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:23.973631 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-d8d76bfb-707b-4471-92cf-2cf38c7ce955 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] validate_networks() for [('64576b11-ff23-432d-a6d4-0c0a0fbf857f', None, None, None)] {{(pid=94111) validate_networks /opt/stack/nova/nova/network/neutron.py:2340}} Jan 15 02:44:23.995780 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-3551f2d1-9998-4443-9701-f96bbb0a60d9 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Flavor limits 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 02:44:23.996252 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-3551f2d1-9998-4443-9701-f96bbb0a60d9 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Image limits 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Jan 15 02:44:23.996790 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-3551f2d1-9998-4443-9701-f96bbb0a60d9 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Flavor pref 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 02:44:23.997289 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-3551f2d1-9998-4443-9701-f96bbb0a60d9 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Image pref 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Jan 15 02:44:23.997746 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-3551f2d1-9998-4443-9701-f96bbb0a60d9 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Jan 15 02:44:24.007828 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3551f2d1-9998-4443-9701-f96bbb0a60d9 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:24.008334 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3551f2d1-9998-4443-9701-f96bbb0a60d9 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:24.009430 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3551f2d1-9998-4443-9701-f96bbb0a60d9 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:24.009729 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3551f2d1-9998-4443-9701-f96bbb0a60d9 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:24.029706 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-3551f2d1-9998-4443-9701-f96bbb0a60d9 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Getting quotas for project 021678626dd143d687a9bf2afee638a9. Resources: {'ram', 'instances', 'cores'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:44:24.034751 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-3551f2d1-9998-4443-9701-f96bbb0a60d9 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Getting quotas for user 995863afc2c1475593bef164d921400f and project 021678626dd143d687a9bf2afee638a9. Resources: {'ram', 'instances', 'cores'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:44:24.048953 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3551f2d1-9998-4443-9701-f96bbb0a60d9 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Going to run 1 instances... {{(pid=94112) _provision_instances /opt/stack/nova/nova/compute/api.py:1263}} Jan 15 02:44:24.052175 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3551f2d1-9998-4443-9701-f96bbb0a60d9 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 333996d9-4a48-440d-bd5f-111d4dddf1a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1807a1cb-835d-4a56-8751-82ffa40b12c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94112) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1661}} Jan 15 02:44:24.103123 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3551f2d1-9998-4443-9701-f96bbb0a60d9 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.971513 Jan 15 02:44:24.104002 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 240/509] 10.222.0.37 () {60 vars in 1137 bytes} [Fri Jan 15 02:44:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 02:44:24.120639 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-85ba6c02-ac3d-4432-a027-c8163a8314c2 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:24.121349 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-85ba6c02-ac3d-4432-a027-c8163a8314c2 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 333996d9-4a48-440d-bd5f-111d4dddf1a4] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:24.214653 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-85ba6c02-ac3d-4432-a027-c8163a8314c2 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:24.227284 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-85ba6c02-ac3d-4432-a027-c8163a8314c2 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4" status: 200 len: 1218 microversion: 2.1 time: 0.116479 Jan 15 02:44:24.231904 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 241/510] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:24 2021] GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4 => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:44:24.239948 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-816ff48f-233c-43e8-b2a1-055905c0367d tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:24.240754 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-816ff48f-233c-43e8-b2a1-055905c0367d tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: adecaebf-3bf6-4dab-a332-5ff4fda684bb] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:24.249220 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-816ff48f-233c-43e8-b2a1-055905c0367d tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:24.249880 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-816ff48f-233c-43e8-b2a1-055905c0367d tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:24.250840 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-816ff48f-233c-43e8-b2a1-055905c0367d tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:24.251439 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-816ff48f-233c-43e8-b2a1-055905c0367d tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:24.519749 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-816ff48f-233c-43e8-b2a1-055905c0367d tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:24.529279 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-816ff48f-233c-43e8-b2a1-055905c0367d tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb" status: 200 len: 1318 microversion: 2.1 time: 0.299686 Jan 15 02:44:24.530265 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 242/511] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:24 2021] GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:24.698142 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1bcc5251-715a-4602-9a2e-822d98d8d173 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:24.698834 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1bcc5251-715a-4602-9a2e-822d98d8d173 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:24.708760 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1bcc5251-715a-4602-9a2e-822d98d8d173 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:24.709401 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1bcc5251-715a-4602-9a2e-822d98d8d173 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:24.710586 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1bcc5251-715a-4602-9a2e-822d98d8d173 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:24.711128 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1bcc5251-715a-4602-9a2e-822d98d8d173 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:24.943738 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-d8d76bfb-707b-4471-92cf-2cf38c7ce955 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Flavor limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 02:44:24.944216 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-d8d76bfb-707b-4471-92cf-2cf38c7ce955 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Image limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Jan 15 02:44:24.944771 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-d8d76bfb-707b-4471-92cf-2cf38c7ce955 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Flavor pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 02:44:24.945446 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-d8d76bfb-707b-4471-92cf-2cf38c7ce955 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Image pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Jan 15 02:44:24.946175 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-d8d76bfb-707b-4471-92cf-2cf38c7ce955 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Jan 15 02:44:24.957717 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d8d76bfb-707b-4471-92cf-2cf38c7ce955 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:24.958235 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d8d76bfb-707b-4471-92cf-2cf38c7ce955 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:24.959136 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d8d76bfb-707b-4471-92cf-2cf38c7ce955 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:24.959641 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d8d76bfb-707b-4471-92cf-2cf38c7ce955 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:24.981203 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-d8d76bfb-707b-4471-92cf-2cf38c7ce955 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Getting quotas for project a4201fdfaa594ca28ac9f59debb11e2a. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:44:24.985792 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-d8d76bfb-707b-4471-92cf-2cf38c7ce955 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Getting quotas for user 9698bc5c912a4f86a7f0961c3cd41364 and project a4201fdfaa594ca28ac9f59debb11e2a. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:44:24.999512 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d8d76bfb-707b-4471-92cf-2cf38c7ce955 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Going to run 1 instances... {{(pid=94111) _provision_instances /opt/stack/nova/nova/compute/api.py:1263}} Jan 15 02:44:25.002307 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d8d76bfb-707b-4471-92cf-2cf38c7ce955 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1807a1cb-835d-4a56-8751-82ffa40b12c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1661}} Jan 15 02:44:25.003815 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1bcc5251-715a-4602-9a2e-822d98d8d173 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:25.013100 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1bcc5251-715a-4602-9a2e-822d98d8d173 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1679 microversion: 2.1 time: 0.325320 Jan 15 02:44:25.013881 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 243/512] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:24 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1679 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:44:25.057164 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d8d76bfb-707b-4471-92cf-2cf38c7ce955 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.324881 Jan 15 02:44:25.057800 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 270/513] 10.222.0.37 () {62 vars in 1178 bytes} [Fri Jan 15 02:44:23 2021] POST /compute/v2.1/servers => generated 402 bytes in 1326 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 15 02:44:25.164736 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-27c75adb-cf31-4bcf-9e6c-d8758ea15f05 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:25.165691 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-27c75adb-cf31-4bcf-9e6c-d8758ea15f05 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:25.254387 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f7246639-cd04-4cdd-8437-472060b8ca37 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:25.255066 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f7246639-cd04-4cdd-8437-472060b8ca37 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 333996d9-4a48-440d-bd5f-111d4dddf1a4] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:25.264626 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-27c75adb-cf31-4bcf-9e6c-d8758ea15f05 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:25.268002 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f7246639-cd04-4cdd-8437-472060b8ca37 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:25.268644 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f7246639-cd04-4cdd-8437-472060b8ca37 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:25.269616 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f7246639-cd04-4cdd-8437-472060b8ca37 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:25.270183 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f7246639-cd04-4cdd-8437-472060b8ca37 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:25.282132 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-27c75adb-cf31-4bcf-9e6c-d8758ea15f05 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:25.290155 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-27c75adb-cf31-4bcf-9e6c-d8758ea15f05 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:25.291765 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-27c75adb-cf31-4bcf-9e6c-d8758ea15f05 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1281 microversion: 2.20 time: 0.227154 Jan 15 02:44:25.292590 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 244/514] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:44:25 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1281 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:44:25.407721 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f7246639-cd04-4cdd-8437-472060b8ca37 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:25.417370 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f7246639-cd04-4cdd-8437-472060b8ca37 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4" status: 200 len: 1270 microversion: 2.1 time: 0.173146 Jan 15 02:44:25.418089 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 271/515] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:25 2021] GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4 => generated 1270 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:44:25.554722 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3c34266e-cf64-4bdf-af7c-89e3bf4fc750 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:25.555396 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3c34266e-cf64-4bdf-af7c-89e3bf4fc750 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: adecaebf-3bf6-4dab-a332-5ff4fda684bb] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:25.563454 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3c34266e-cf64-4bdf-af7c-89e3bf4fc750 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:25.563892 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3c34266e-cf64-4bdf-af7c-89e3bf4fc750 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:25.564744 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3c34266e-cf64-4bdf-af7c-89e3bf4fc750 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:25.565870 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3c34266e-cf64-4bdf-af7c-89e3bf4fc750 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:25.823107 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3c34266e-cf64-4bdf-af7c-89e3bf4fc750 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:25.832393 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3c34266e-cf64-4bdf-af7c-89e3bf4fc750 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb" status: 200 len: 1318 microversion: 2.1 time: 0.288249 Jan 15 02:44:25.833234 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 245/516] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:25 2021] GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:26.040629 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ac3516c2-2dd4-42b3-a590-5c95f26697ee tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:26.042055 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ac3516c2-2dd4-42b3-a590-5c95f26697ee tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:26.052154 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ac3516c2-2dd4-42b3-a590-5c95f26697ee tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:26.053293 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ac3516c2-2dd4-42b3-a590-5c95f26697ee tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:26.054386 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ac3516c2-2dd4-42b3-a590-5c95f26697ee tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:26.055115 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ac3516c2-2dd4-42b3-a590-5c95f26697ee tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:26.324786 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1d45d012-a780-4c19-b06b-69aba282a84a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:26.325497 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1d45d012-a780-4c19-b06b-69aba282a84a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:26.334764 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1d45d012-a780-4c19-b06b-69aba282a84a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:26.335278 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1d45d012-a780-4c19-b06b-69aba282a84a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:26.336371 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1d45d012-a780-4c19-b06b-69aba282a84a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:26.336911 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1d45d012-a780-4c19-b06b-69aba282a84a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:26.480986 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1d45d012-a780-4c19-b06b-69aba282a84a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:26.487796 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-ac3516c2-2dd4-42b3-a590-5c95f26697ee tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:26.498650 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ac3516c2-2dd4-42b3-a590-5c95f26697ee tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1679 microversion: 2.1 time: 0.469205 Jan 15 02:44:26.499752 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1d45d012-a780-4c19-b06b-69aba282a84a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:26.500217 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 272/517] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:26 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1679 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:26.507565 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1d45d012-a780-4c19-b06b-69aba282a84a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:26.508898 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1d45d012-a780-4c19-b06b-69aba282a84a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1333 microversion: 2.20 time: 0.200703 Jan 15 02:44:26.509786 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 246/518] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:44:26 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1333 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:44:26.512500 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-36c81c47-4728-4706-b368-1a97abac33f0 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:26.513384 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-36c81c47-4728-4706-b368-1a97abac33f0 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 333996d9-4a48-440d-bd5f-111d4dddf1a4] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:26.522549 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-36c81c47-4728-4706-b368-1a97abac33f0 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:26.523469 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-36c81c47-4728-4706-b368-1a97abac33f0 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:26.524343 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-36c81c47-4728-4706-b368-1a97abac33f0 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:26.524852 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-36c81c47-4728-4706-b368-1a97abac33f0 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:26.822290 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-36c81c47-4728-4706-b368-1a97abac33f0 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:26.836572 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-36c81c47-4728-4706-b368-1a97abac33f0 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4" status: 200 len: 1276 microversion: 2.1 time: 0.334744 Jan 15 02:44:26.837471 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 273/519] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:26 2021] GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4 => generated 1276 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:26.860504 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7815d7bd-fa07-4c1c-afe4-f13bc48acf5a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:26.861434 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-7815d7bd-fa07-4c1c-afe4-f13bc48acf5a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: adecaebf-3bf6-4dab-a332-5ff4fda684bb] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:26.871743 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7815d7bd-fa07-4c1c-afe4-f13bc48acf5a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:26.872435 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7815d7bd-fa07-4c1c-afe4-f13bc48acf5a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:26.874817 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7815d7bd-fa07-4c1c-afe4-f13bc48acf5a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:26.875457 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7815d7bd-fa07-4c1c-afe4-f13bc48acf5a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:27.526367 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-39557c73-85d6-46ea-b1ee-4af4e8eecc85 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:27.527233 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-39557c73-85d6-46ea-b1ee-4af4e8eecc85 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:27.540616 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-7815d7bd-fa07-4c1c-afe4-f13bc48acf5a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:27.551366 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-39557c73-85d6-46ea-b1ee-4af4e8eecc85 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:27.557177 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-7815d7bd-fa07-4c1c-afe4-f13bc48acf5a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb" status: 200 len: 1508 microversion: 2.1 time: 0.706117 Jan 15 02:44:27.558639 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-39557c73-85d6-46ea-b1ee-4af4e8eecc85 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:27.559646 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-39557c73-85d6-46ea-b1ee-4af4e8eecc85 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:27.560146 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-39557c73-85d6-46ea-b1ee-4af4e8eecc85 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:27.565481 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 247/520] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:26 2021] GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb => generated 1508 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:27.586421 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f26c5884-fc50-465c-bed1-0d88955e8f65 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:27.588473 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f26c5884-fc50-465c-bed1-0d88955e8f65 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:27.604036 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f26c5884-fc50-465c-bed1-0d88955e8f65 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:27.604937 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f26c5884-fc50-465c-bed1-0d88955e8f65 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:27.606061 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f26c5884-fc50-465c-bed1-0d88955e8f65 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:27.606780 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f26c5884-fc50-465c-bed1-0d88955e8f65 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:27.826990 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f26c5884-fc50-465c-bed1-0d88955e8f65 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:27.843789 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f26c5884-fc50-465c-bed1-0d88955e8f65 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:27.853234 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f26c5884-fc50-465c-bed1-0d88955e8f65 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:27.854460 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f26c5884-fc50-465c-bed1-0d88955e8f65 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1339 microversion: 2.20 time: 0.287833 Jan 15 02:44:27.858363 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 248/521] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:44:27 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1339 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:44:27.873159 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f07d6f77-93a1-40ec-980f-0be250d24b63 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be0fc3ae-1c60-4c10-bdd2-a65e8241ba9d"}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:27.874632 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f07d6f77-93a1-40ec-980f-0be250d24b63 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: adecaebf-3bf6-4dab-a332-5ff4fda684bb] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:27.883846 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f07d6f77-93a1-40ec-980f-0be250d24b63 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:27.884697 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f07d6f77-93a1-40ec-980f-0be250d24b63 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:27.885381 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f07d6f77-93a1-40ec-980f-0be250d24b63 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:27.885878 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f07d6f77-93a1-40ec-980f-0be250d24b63 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:27.982129 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-39557c73-85d6-46ea-b1ee-4af4e8eecc85 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:27.998018 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-39557c73-85d6-46ea-b1ee-4af4e8eecc85 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1679 microversion: 2.1 time: 0.482968 Jan 15 02:44:27.998747 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 274/522] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:27 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1679 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:28.012132 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9c209630-aaaf-429a-97f4-ca13ad79f335 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:28.012922 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9c209630-aaaf-429a-97f4-ca13ad79f335 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 333996d9-4a48-440d-bd5f-111d4dddf1a4] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:28.023545 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9c209630-aaaf-429a-97f4-ca13ad79f335 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:28.024152 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9c209630-aaaf-429a-97f4-ca13ad79f335 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:28.025500 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9c209630-aaaf-429a-97f4-ca13ad79f335 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:28.026071 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9c209630-aaaf-429a-97f4-ca13ad79f335 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:28.338969 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-f07d6f77-93a1-40ec-980f-0be250d24b63 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] HTTP exception thrown: Invalid input received: Invalid volume: Volume be0fc3ae-1c60-4c10-bdd2-a65e8241ba9d status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-a426093d-1d50-4f64-a20c-b2a56b28da17) Jan 15 02:44:28.340653 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f07d6f77-93a1-40ec-980f-0be250d24b63 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Returning 400 to user: Invalid input received: Invalid volume: Volume be0fc3ae-1c60-4c10-bdd2-a65e8241ba9d status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-a426093d-1d50-4f64-a20c-b2a56b28da17) {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:44:28.340790 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f07d6f77-93a1-40ec-980f-0be250d24b63 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "POST /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb/os-volume_attachments" status: 400 len: 279 microversion: 2.1 time: 0.484749 Jan 15 02:44:28.341759 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 249/523] 10.222.0.37 () {60 vars in 1313 bytes} [Fri Jan 15 02:44:27 2021] POST /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb/os-volume_attachments => generated 279 bytes in 486 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 02:44:28.474255 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e0b8d656-8b50-4467-a06c-1daa70abe908 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:28.474960 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e0b8d656-8b50-4467-a06c-1daa70abe908 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 1e1481d5-324e-4893-b3fa-9815f0688933] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:28.483929 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e0b8d656-8b50-4467-a06c-1daa70abe908 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:28.484492 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e0b8d656-8b50-4467-a06c-1daa70abe908 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:28.485304 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e0b8d656-8b50-4467-a06c-1daa70abe908 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:28.485958 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e0b8d656-8b50-4467-a06c-1daa70abe908 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:28.529380 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-9c209630-aaaf-429a-97f4-ca13ad79f335 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:28.540589 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9c209630-aaaf-429a-97f4-ca13ad79f335 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4" status: 200 len: 1318 microversion: 2.1 time: 0.540641 Jan 15 02:44:28.542124 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 275/524] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:27 2021] GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4 => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:28.833608 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e0b8d656-8b50-4467-a06c-1daa70abe908 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "DELETE /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933/os-volume_attachments/be0fc3ae-1c60-4c10-bdd2-a65e8241ba9d" status: 202 len: 0 microversion: 2.1 time: 0.369160 Jan 15 02:44:28.839319 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 250/525] 10.222.0.37 () {58 vars in 1406 bytes} [Fri Jan 15 02:44:28 2021] DELETE /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933/os-volume_attachments/be0fc3ae-1c60-4c10-bdd2-a65e8241ba9d => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 02:44:28.890017 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1fe4c4ca-0aee-499b-b661-32f2ed0fec22 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:28.895036 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1fe4c4ca-0aee-499b-b661-32f2ed0fec22 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:28.905632 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1fe4c4ca-0aee-499b-b661-32f2ed0fec22 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:28.906814 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1fe4c4ca-0aee-499b-b661-32f2ed0fec22 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:28.907849 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1fe4c4ca-0aee-499b-b661-32f2ed0fec22 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:28.908502 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1fe4c4ca-0aee-499b-b661-32f2ed0fec22 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:29.030528 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b87637b4-9d2d-441c-a5a4-65a66d4069bb tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:29.031317 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b87637b4-9d2d-441c-a5a4-65a66d4069bb tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:29.057568 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b87637b4-9d2d-441c-a5a4-65a66d4069bb tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:29.058947 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b87637b4-9d2d-441c-a5a4-65a66d4069bb tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:29.060197 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b87637b4-9d2d-441c-a5a4-65a66d4069bb tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:29.060851 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b87637b4-9d2d-441c-a5a4-65a66d4069bb tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:29.452552 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b87637b4-9d2d-441c-a5a4-65a66d4069bb tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:29.462781 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b87637b4-9d2d-441c-a5a4-65a66d4069bb tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1679 microversion: 2.1 time: 0.444905 Jan 15 02:44:29.463510 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 251/526] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:29 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1679 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:29.464883 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1fe4c4ca-0aee-499b-b661-32f2ed0fec22 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:29.483353 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1fe4c4ca-0aee-499b-b661-32f2ed0fec22 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:29.493054 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1fe4c4ca-0aee-499b-b661-32f2ed0fec22 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:29.494436 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1fe4c4ca-0aee-499b-b661-32f2ed0fec22 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1407 microversion: 2.20 time: 0.623720 Jan 15 02:44:29.495054 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 276/527] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:44:28 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1407 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:44:29.565158 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4d9d811b-0d51-42ec-beca-ec8939551d4d tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:29.566055 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4d9d811b-0d51-42ec-beca-ec8939551d4d tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 333996d9-4a48-440d-bd5f-111d4dddf1a4] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:29.574438 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4d9d811b-0d51-42ec-beca-ec8939551d4d tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:29.575103 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4d9d811b-0d51-42ec-beca-ec8939551d4d tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:29.576083 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4d9d811b-0d51-42ec-beca-ec8939551d4d tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:29.576705 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4d9d811b-0d51-42ec-beca-ec8939551d4d tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:29.857583 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-a0644433-010b-4d07-8e06-63ccb6e25525 req-639c5679-4356-4b04-bd5c-a82549d5bba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "333996d9-4a48-440d-bd5f-111d4dddf1a4", "tag": "5606fd40-58f7-4a3a-ba68-db04deb9c4ac"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:29.865070 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:44:29.865070 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:44:29.874545 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-a0644433-010b-4d07-8e06-63ccb6e25525 req-639c5679-4356-4b04-bd5c-a82549d5bba4 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:29.875045 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-a0644433-010b-4d07-8e06-63ccb6e25525 req-639c5679-4356-4b04-bd5c-a82549d5bba4 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:29.897278 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-a0644433-010b-4d07-8e06-63ccb6e25525 req-639c5679-4356-4b04-bd5c-a82549d5bba4 service nova] Creating event network-changed:5606fd40-58f7-4a3a-ba68-db04deb9c4ac for instance 333996d9-4a48-440d-bd5f-111d4dddf1a4 on hv-cinder-76330 Jan 15 02:44:29.903493 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-a0644433-010b-4d07-8e06-63ccb6e25525 req-639c5679-4356-4b04-bd5c-a82549d5bba4 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056074 Jan 15 02:44:29.904838 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 277/528] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:44:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:44:30.072512 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4d9d811b-0d51-42ec-beca-ec8939551d4d tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:30.082955 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4d9d811b-0d51-42ec-beca-ec8939551d4d tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4" status: 200 len: 1318 microversion: 2.1 time: 0.526594 Jan 15 02:44:30.083766 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 252/529] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:29 2021] GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4 => generated 1318 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:30.219233 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9a6112ba-1ff5-41af-a503-492ab5c7dd50 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-549846297", "imageRef": "1807a1cb-835d-4a56-8751-82ffa40b12c9", "flavorRef": "452", "networks": [{"uuid": "570f6e31-1bda-4ebb-b8b9-ce9a0b49f0a4"}]}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:30.317187 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-9a6112ba-1ff5-41af-a503-492ab5c7dd50 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] validate_networks() for [('570f6e31-1bda-4ebb-b8b9-ce9a0b49f0a4', None, None, None)] {{(pid=94111) validate_networks /opt/stack/nova/nova/network/neutron.py:2340}} Jan 15 02:44:30.374380 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-18f29971-beac-493d-b059-84487b95e8ce req-98b0335e-9b50-4813-8b5d-d78896b272d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "813b0cda-aa4a-4e8d-a4c7-2042b9415e81", "tag": "6e4e5bd0-fe30-49a1-b6cb-89dcd970bde9"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:30.382934 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:44:30.382934 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:44:30.394691 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-18f29971-beac-493d-b059-84487b95e8ce req-98b0335e-9b50-4813-8b5d-d78896b272d2 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:30.395436 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-18f29971-beac-493d-b059-84487b95e8ce req-98b0335e-9b50-4813-8b5d-d78896b272d2 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:30.415667 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-18f29971-beac-493d-b059-84487b95e8ce req-98b0335e-9b50-4813-8b5d-d78896b272d2 service nova] Creating event network-changed:6e4e5bd0-fe30-49a1-b6cb-89dcd970bde9 for instance 813b0cda-aa4a-4e8d-a4c7-2042b9415e81 on hv-cinder-76330 Jan 15 02:44:30.421835 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-18f29971-beac-493d-b059-84487b95e8ce req-98b0335e-9b50-4813-8b5d-d78896b272d2 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057043 Jan 15 02:44:30.423025 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 253/530] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:44:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:44:30.494349 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-93a54d25-2f04-41c2-adcf-c0960b7982f6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:30.495413 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-93a54d25-2f04-41c2-adcf-c0960b7982f6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:30.504807 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-93a54d25-2f04-41c2-adcf-c0960b7982f6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:30.505666 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-93a54d25-2f04-41c2-adcf-c0960b7982f6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:30.506678 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-93a54d25-2f04-41c2-adcf-c0960b7982f6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:30.507502 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-93a54d25-2f04-41c2-adcf-c0960b7982f6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:30.940152 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-93a54d25-2f04-41c2-adcf-c0960b7982f6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:30.950159 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-93a54d25-2f04-41c2-adcf-c0960b7982f6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1679 microversion: 2.1 time: 0.471513 Jan 15 02:44:30.950793 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 254/531] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:30 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1679 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:44:30.961557 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-806ded69-0235-4eea-af17-598eb39b5d41 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:30.962236 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-806ded69-0235-4eea-af17-598eb39b5d41 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:30.970302 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-806ded69-0235-4eea-af17-598eb39b5d41 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:30.970822 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-806ded69-0235-4eea-af17-598eb39b5d41 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:30.971671 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-806ded69-0235-4eea-af17-598eb39b5d41 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:30.972169 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-806ded69-0235-4eea-af17-598eb39b5d41 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:31.401117 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-9a6112ba-1ff5-41af-a503-492ab5c7dd50 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Flavor limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 02:44:31.401998 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-9a6112ba-1ff5-41af-a503-492ab5c7dd50 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Image limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Jan 15 02:44:31.402851 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-9a6112ba-1ff5-41af-a503-492ab5c7dd50 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Flavor pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 02:44:31.403578 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-9a6112ba-1ff5-41af-a503-492ab5c7dd50 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Image pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Jan 15 02:44:31.404049 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-9a6112ba-1ff5-41af-a503-492ab5c7dd50 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Jan 15 02:44:31.414014 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9a6112ba-1ff5-41af-a503-492ab5c7dd50 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:31.422882 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-806ded69-0235-4eea-af17-598eb39b5d41 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:31.427560 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9a6112ba-1ff5-41af-a503-492ab5c7dd50 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:31.428536 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9a6112ba-1ff5-41af-a503-492ab5c7dd50 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:31.429136 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9a6112ba-1ff5-41af-a503-492ab5c7dd50 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:31.441436 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-806ded69-0235-4eea-af17-598eb39b5d41 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:31.448683 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-9a6112ba-1ff5-41af-a503-492ab5c7dd50 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Getting quotas for project dd56ed8011104bf0a99ad88d8911ead9. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:44:31.448972 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-806ded69-0235-4eea-af17-598eb39b5d41 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:31.449953 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-806ded69-0235-4eea-af17-598eb39b5d41 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1407 microversion: 2.20 time: 0.498142 Jan 15 02:44:31.450857 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 255/532] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:44:30 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1407 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:44:31.452979 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-9a6112ba-1ff5-41af-a503-492ab5c7dd50 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Getting quotas for user 63160ec41a3b4c9e839a6aefe3c269d0 and project dd56ed8011104bf0a99ad88d8911ead9. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:44:31.466811 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9a6112ba-1ff5-41af-a503-492ab5c7dd50 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Going to run 1 instances... {{(pid=94111) _provision_instances /opt/stack/nova/nova/compute/api.py:1263}} Jan 15 02:44:31.469573 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9a6112ba-1ff5-41af-a503-492ab5c7dd50 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: d6f5f889-a811-42cd-915e-ecaa5ac5b1ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1807a1cb-835d-4a56-8751-82ffa40b12c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1661}} Jan 15 02:44:31.469718 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-235bfe65-8152-4c35-8465-84a5514ad9e9 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:31.470363 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-235bfe65-8152-4c35-8465-84a5514ad9e9 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 333996d9-4a48-440d-bd5f-111d4dddf1a4] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:31.480849 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-235bfe65-8152-4c35-8465-84a5514ad9e9 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:31.481417 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-235bfe65-8152-4c35-8465-84a5514ad9e9 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:31.482310 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-235bfe65-8152-4c35-8465-84a5514ad9e9 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:31.482806 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-235bfe65-8152-4c35-8465-84a5514ad9e9 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:31.525965 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9a6112ba-1ff5-41af-a503-492ab5c7dd50 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.324768 Jan 15 02:44:31.527027 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 278/533] 10.222.0.37 () {60 vars in 1137 bytes} [Fri Jan 15 02:44:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 1327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 02:44:31.546003 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-97aa4054-6ec7-4e95-996e-190c6d5950f6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:31.546679 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-97aa4054-6ec7-4e95-996e-190c6d5950f6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: d6f5f889-a811-42cd-915e-ecaa5ac5b1ed] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:31.892660 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-97aa4054-6ec7-4e95-996e-190c6d5950f6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:31.905640 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-97aa4054-6ec7-4e95-996e-190c6d5950f6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed" status: 200 len: 1217 microversion: 2.1 time: 0.370972 Jan 15 02:44:31.907913 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 279/534] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:31 2021] GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed => generated 1217 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:32.002552 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2413cae4-ec33-465f-ac5e-077b31539da6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:32.003354 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2413cae4-ec33-465f-ac5e-077b31539da6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:32.021798 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2413cae4-ec33-465f-ac5e-077b31539da6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:32.023135 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2413cae4-ec33-465f-ac5e-077b31539da6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:32.025366 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2413cae4-ec33-465f-ac5e-077b31539da6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:32.027158 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2413cae4-ec33-465f-ac5e-077b31539da6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:32.149635 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-235bfe65-8152-4c35-8465-84a5514ad9e9 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:32.159943 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-235bfe65-8152-4c35-8465-84a5514ad9e9 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4" status: 200 len: 1318 microversion: 2.1 time: 0.699669 Jan 15 02:44:32.161673 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 256/535] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:31 2021] GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4 => generated 1318 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:32.477411 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-10060de4-c93c-4dc9-8548-72a15382e798 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:32.478109 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-10060de4-c93c-4dc9-8548-72a15382e798 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:32.486345 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-10060de4-c93c-4dc9-8548-72a15382e798 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:32.486867 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-10060de4-c93c-4dc9-8548-72a15382e798 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:32.488686 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-10060de4-c93c-4dc9-8548-72a15382e798 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:32.489595 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-10060de4-c93c-4dc9-8548-72a15382e798 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:32.523876 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-2413cae4-ec33-465f-ac5e-077b31539da6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:32.533426 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2413cae4-ec33-465f-ac5e-077b31539da6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1679 microversion: 2.1 time: 0.567701 Jan 15 02:44:32.534378 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 280/536] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:31 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1679 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:32.931491 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-fd808560-6657-4787-9e87-8a3af78cd185 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:32.932368 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-fd808560-6657-4787-9e87-8a3af78cd185 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: d6f5f889-a811-42cd-915e-ecaa5ac5b1ed] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:32.940721 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fd808560-6657-4787-9e87-8a3af78cd185 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:32.941435 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fd808560-6657-4787-9e87-8a3af78cd185 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:32.942633 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fd808560-6657-4787-9e87-8a3af78cd185 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:32.943259 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fd808560-6657-4787-9e87-8a3af78cd185 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:32.971088 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-10060de4-c93c-4dc9-8548-72a15382e798 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:32.987139 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-10060de4-c93c-4dc9-8548-72a15382e798 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:32.994343 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-10060de4-c93c-4dc9-8548-72a15382e798 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:32.995857 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-10060de4-c93c-4dc9-8548-72a15382e798 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1407 microversion: 2.20 time: 0.530140 Jan 15 02:44:32.996897 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 257/537] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:44:32 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1407 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:44:33.110976 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-fd808560-6657-4787-9e87-8a3af78cd185 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:33.123541 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-fd808560-6657-4787-9e87-8a3af78cd185 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed" status: 200 len: 1277 microversion: 2.1 time: 0.201609 Jan 15 02:44:33.124509 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 281/538] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:32 2021] GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed => generated 1277 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:33.184643 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-bc04a1be-0414-430a-a920-2df8b821feae tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:33.197611 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-bc04a1be-0414-430a-a920-2df8b821feae tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 333996d9-4a48-440d-bd5f-111d4dddf1a4] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:33.206380 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bc04a1be-0414-430a-a920-2df8b821feae tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:33.207466 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bc04a1be-0414-430a-a920-2df8b821feae tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:33.208552 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bc04a1be-0414-430a-a920-2df8b821feae tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:33.209048 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bc04a1be-0414-430a-a920-2df8b821feae tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:33.482342 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-bc04a1be-0414-430a-a920-2df8b821feae tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:33.492187 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-bc04a1be-0414-430a-a920-2df8b821feae tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4" status: 200 len: 1318 microversion: 2.1 time: 0.316726 Jan 15 02:44:33.492812 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 258/539] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:33 2021] GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:44:33.558544 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-474d2522-a4bf-4a5f-bfdd-d29bb8ebab50 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:33.559207 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-474d2522-a4bf-4a5f-bfdd-d29bb8ebab50 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:33.568828 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-474d2522-a4bf-4a5f-bfdd-d29bb8ebab50 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:33.569402 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-474d2522-a4bf-4a5f-bfdd-d29bb8ebab50 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:33.570267 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-474d2522-a4bf-4a5f-bfdd-d29bb8ebab50 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:33.570766 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-474d2522-a4bf-4a5f-bfdd-d29bb8ebab50 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:34.027688 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-474d2522-a4bf-4a5f-bfdd-d29bb8ebab50 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:34.032577 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3d8dfb31-77e2-46fe-8201-a28df822c7aa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:34.033934 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3d8dfb31-77e2-46fe-8201-a28df822c7aa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:34.044789 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-474d2522-a4bf-4a5f-bfdd-d29bb8ebab50 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1679 microversion: 2.1 time: 0.496453 Jan 15 02:44:34.045804 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 282/540] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:33 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1679 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:34.048443 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3d8dfb31-77e2-46fe-8201-a28df822c7aa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:34.049260 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3d8dfb31-77e2-46fe-8201-a28df822c7aa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:34.050350 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3d8dfb31-77e2-46fe-8201-a28df822c7aa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:34.051554 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3d8dfb31-77e2-46fe-8201-a28df822c7aa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:34.151618 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-38bb9556-ffd5-43d2-a2e2-2e33ae928dff tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:34.152416 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-38bb9556-ffd5-43d2-a2e2-2e33ae928dff tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: d6f5f889-a811-42cd-915e-ecaa5ac5b1ed] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:34.162420 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-38bb9556-ffd5-43d2-a2e2-2e33ae928dff tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:34.162906 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-38bb9556-ffd5-43d2-a2e2-2e33ae928dff tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:34.163957 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-38bb9556-ffd5-43d2-a2e2-2e33ae928dff tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:34.164521 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-38bb9556-ffd5-43d2-a2e2-2e33ae928dff tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:34.336249 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3d8dfb31-77e2-46fe-8201-a28df822c7aa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:34.352741 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3d8dfb31-77e2-46fe-8201-a28df822c7aa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:34.359648 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3d8dfb31-77e2-46fe-8201-a28df822c7aa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:34.360836 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3d8dfb31-77e2-46fe-8201-a28df822c7aa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1407 microversion: 2.20 time: 0.348124 Jan 15 02:44:34.361458 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 259/541] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:44:34 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1407 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:44:34.518924 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-307ee28d-bcb7-42a2-b62a-58bb19ac39ed tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:34.520407 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-307ee28d-bcb7-42a2-b62a-58bb19ac39ed tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 333996d9-4a48-440d-bd5f-111d4dddf1a4] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:34.530780 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-307ee28d-bcb7-42a2-b62a-58bb19ac39ed tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:34.530780 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-307ee28d-bcb7-42a2-b62a-58bb19ac39ed tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:34.531305 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-307ee28d-bcb7-42a2-b62a-58bb19ac39ed tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:34.531792 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-307ee28d-bcb7-42a2-b62a-58bb19ac39ed tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:34.678339 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-38bb9556-ffd5-43d2-a2e2-2e33ae928dff tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:34.699189 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-38bb9556-ffd5-43d2-a2e2-2e33ae928dff tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed" status: 200 len: 1317 microversion: 2.1 time: 0.559339 Jan 15 02:44:34.699189 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 283/542] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:34 2021] GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed => generated 1317 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:44:34.803692 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-307ee28d-bcb7-42a2-b62a-58bb19ac39ed tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:34.813174 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-307ee28d-bcb7-42a2-b62a-58bb19ac39ed tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4" status: 200 len: 1318 microversion: 2.1 time: 0.305129 Jan 15 02:44:34.813909 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 260/543] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:34 2021] GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:35.079833 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-60d8fc30-5b28-403a-ac5b-96d2cf7661cf tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:35.080416 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-60d8fc30-5b28-403a-ac5b-96d2cf7661cf tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:35.088726 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-60d8fc30-5b28-403a-ac5b-96d2cf7661cf tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:35.089269 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-60d8fc30-5b28-403a-ac5b-96d2cf7661cf tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:35.090119 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-60d8fc30-5b28-403a-ac5b-96d2cf7661cf tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:35.090600 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-60d8fc30-5b28-403a-ac5b-96d2cf7661cf tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:35.387148 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-809968ec-a1cc-465e-b6a7-eeea10617bcf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:35.387790 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-809968ec-a1cc-465e-b6a7-eeea10617bcf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:35.396929 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-809968ec-a1cc-465e-b6a7-eeea10617bcf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:35.397503 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-809968ec-a1cc-465e-b6a7-eeea10617bcf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:35.398613 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-809968ec-a1cc-465e-b6a7-eeea10617bcf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:35.399102 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-809968ec-a1cc-465e-b6a7-eeea10617bcf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:35.524354 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-60d8fc30-5b28-403a-ac5b-96d2cf7661cf tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:35.538608 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-60d8fc30-5b28-403a-ac5b-96d2cf7661cf tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1656 microversion: 2.1 time: 0.467956 Jan 15 02:44:35.554244 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 284/544] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:35 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1656 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:35.572289 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-263134ec-6530-4929-8aa2-d73cd275d830 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:35.582635 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-263134ec-6530-4929-8aa2-d73cd275d830 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:35.583425 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-263134ec-6530-4929-8aa2-d73cd275d830 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:35.705938 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-263134ec-6530-4929-8aa2-d73cd275d830 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Going to try to start instance {{(pid=94111) start /opt/stack/nova/nova/compute/api.py:2598}} Jan 15 02:44:35.783777 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-809968ec-a1cc-465e-b6a7-eeea10617bcf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:35.803512 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-263134ec-6530-4929-8aa2-d73cd275d830 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action" status: 202 len: 0 microversion: 2.1 time: 0.247489 Jan 15 02:44:35.804070 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-809968ec-a1cc-465e-b6a7-eeea10617bcf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:35.804865 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 285/545] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:44:35 2021] POST /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:44:35.817885 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4a714004-5c20-4582-9100-ba639cbc7bd1 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:35.818960 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4a714004-5c20-4582-9100-ba639cbc7bd1 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: d6f5f889-a811-42cd-915e-ecaa5ac5b1ed] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:35.831055 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4a714004-5c20-4582-9100-ba639cbc7bd1 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:35.832389 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4a714004-5c20-4582-9100-ba639cbc7bd1 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:35.833618 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4a714004-5c20-4582-9100-ba639cbc7bd1 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:35.834279 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4a714004-5c20-4582-9100-ba639cbc7bd1 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:35.841454 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-809968ec-a1cc-465e-b6a7-eeea10617bcf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:35.843143 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-809968ec-a1cc-465e-b6a7-eeea10617bcf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1407 microversion: 2.20 time: 0.465857 Jan 15 02:44:35.858472 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 261/546] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:44:35 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1407 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:44:35.871251 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f6995bbc-645a-437d-9c48-79e225869d66 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:35.871920 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f6995bbc-645a-437d-9c48-79e225869d66 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:35.880808 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f6995bbc-645a-437d-9c48-79e225869d66 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:35.881401 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f6995bbc-645a-437d-9c48-79e225869d66 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:35.882258 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f6995bbc-645a-437d-9c48-79e225869d66 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:35.882752 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f6995bbc-645a-437d-9c48-79e225869d66 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:36.382325 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f6995bbc-645a-437d-9c48-79e225869d66 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:36.407460 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f6995bbc-645a-437d-9c48-79e225869d66 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1665 microversion: 2.1 time: 0.546659 Jan 15 02:44:36.410259 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 262/547] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:35 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1665 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:36.443727 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-71ea3ae3-a116-4048-9a8b-e42650367564 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:36.444540 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-71ea3ae3-a116-4048-9a8b-e42650367564 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 333996d9-4a48-440d-bd5f-111d4dddf1a4] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:36.455686 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-71ea3ae3-a116-4048-9a8b-e42650367564 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:36.456183 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-71ea3ae3-a116-4048-9a8b-e42650367564 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:36.457878 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-71ea3ae3-a116-4048-9a8b-e42650367564 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:36.458954 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-71ea3ae3-a116-4048-9a8b-e42650367564 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:36.531497 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4a714004-5c20-4582-9100-ba639cbc7bd1 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:36.555457 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4a714004-5c20-4582-9100-ba639cbc7bd1 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed" status: 200 len: 1317 microversion: 2.1 time: 0.748990 Jan 15 02:44:36.556242 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 286/548] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:35 2021] GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed => generated 1317 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:36.575132 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-5f083bb5-94fa-43aa-8bfa-1f7ff8837f14 req-1b424ad8-bd78-4faa-bb1c-c0a0a15cbadd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "333996d9-4a48-440d-bd5f-111d4dddf1a4", "name": "network-vif-plugged", "status": "completed", "tag": "5606fd40-58f7-4a3a-ba68-db04deb9c4ac"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:36.592217 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:44:36.592217 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:44:36.603076 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-5f083bb5-94fa-43aa-8bfa-1f7ff8837f14 req-1b424ad8-bd78-4faa-bb1c-c0a0a15cbadd service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:36.603696 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-5f083bb5-94fa-43aa-8bfa-1f7ff8837f14 req-1b424ad8-bd78-4faa-bb1c-c0a0a15cbadd service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:36.641337 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-5f083bb5-94fa-43aa-8bfa-1f7ff8837f14 req-1b424ad8-bd78-4faa-bb1c-c0a0a15cbadd service nova] Creating event network-vif-plugged:5606fd40-58f7-4a3a-ba68-db04deb9c4ac for instance 333996d9-4a48-440d-bd5f-111d4dddf1a4 on hv-cinder-76330 Jan 15 02:44:36.648064 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-5f083bb5-94fa-43aa-8bfa-1f7ff8837f14 req-1b424ad8-bd78-4faa-bb1c-c0a0a15cbadd service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089587 Jan 15 02:44:36.648991 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 287/549] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:44:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:44:36.872031 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-0f595bf6-a34e-470d-94e0-9116daaae87e req-7e418415-f8ab-477f-b954-f395517fbea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6f5f889-a811-42cd-915e-ecaa5ac5b1ed", "tag": "72ec9465-1f3d-446b-b264-6927708f49da"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:36.887152 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:44:36.887152 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:44:36.898432 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-0f595bf6-a34e-470d-94e0-9116daaae87e req-7e418415-f8ab-477f-b954-f395517fbea8 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:36.898846 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-0f595bf6-a34e-470d-94e0-9116daaae87e req-7e418415-f8ab-477f-b954-f395517fbea8 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:36.902159 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-71ea3ae3-a116-4048-9a8b-e42650367564 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:36.915988 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-71ea3ae3-a116-4048-9a8b-e42650367564 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4" status: 200 len: 1318 microversion: 2.1 time: 0.496037 Jan 15 02:44:36.916771 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 263/550] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:36 2021] GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4 => generated 1318 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:36.927225 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-0f595bf6-a34e-470d-94e0-9116daaae87e req-7e418415-f8ab-477f-b954-f395517fbea8 service nova] Creating event network-changed:72ec9465-1f3d-446b-b264-6927708f49da for instance d6f5f889-a811-42cd-915e-ecaa5ac5b1ed on hv-cinder-76330 Jan 15 02:44:36.928152 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-38ce6118-8f5b-4b91-8253-8b82d0f6c39a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:36.928931 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-38ce6118-8f5b-4b91-8253-8b82d0f6c39a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:36.930761 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-0f595bf6-a34e-470d-94e0-9116daaae87e req-7e418415-f8ab-477f-b954-f395517fbea8 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080754 Jan 15 02:44:36.931427 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 288/551] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:44:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:44:36.937438 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-38ce6118-8f5b-4b91-8253-8b82d0f6c39a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:36.937955 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-38ce6118-8f5b-4b91-8253-8b82d0f6c39a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:36.938818 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-38ce6118-8f5b-4b91-8253-8b82d0f6c39a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:36.939518 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-38ce6118-8f5b-4b91-8253-8b82d0f6c39a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:37.439432 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-587c2aa7-3700-4a12-8a44-310b7aac6644 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:37.440221 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-587c2aa7-3700-4a12-8a44-310b7aac6644 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:37.451541 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-587c2aa7-3700-4a12-8a44-310b7aac6644 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:37.452389 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-587c2aa7-3700-4a12-8a44-310b7aac6644 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:37.453613 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-587c2aa7-3700-4a12-8a44-310b7aac6644 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:37.454326 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-587c2aa7-3700-4a12-8a44-310b7aac6644 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:37.496178 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-38ce6118-8f5b-4b91-8253-8b82d0f6c39a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:37.520056 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-38ce6118-8f5b-4b91-8253-8b82d0f6c39a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:37.529654 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-38ce6118-8f5b-4b91-8253-8b82d0f6c39a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:37.531099 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-38ce6118-8f5b-4b91-8253-8b82d0f6c39a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1407 microversion: 2.20 time: 0.613182 Jan 15 02:44:37.531849 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 264/552] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:44:36 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1407 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:44:37.587832 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-802b5f5c-2a8a-47a0-a373-271569b64ac6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:37.589656 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-802b5f5c-2a8a-47a0-a373-271569b64ac6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: d6f5f889-a811-42cd-915e-ecaa5ac5b1ed] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:37.605518 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-802b5f5c-2a8a-47a0-a373-271569b64ac6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:37.606193 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-802b5f5c-2a8a-47a0-a373-271569b64ac6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:37.607164 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-802b5f5c-2a8a-47a0-a373-271569b64ac6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:37.607790 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-802b5f5c-2a8a-47a0-a373-271569b64ac6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:37.772952 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-587c2aa7-3700-4a12-8a44-310b7aac6644 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:37.783282 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-587c2aa7-3700-4a12-8a44-310b7aac6644 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1665 microversion: 2.1 time: 0.355869 Jan 15 02:44:37.784215 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 289/553] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:37 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1665 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:37.877436 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-802b5f5c-2a8a-47a0-a373-271569b64ac6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:37.886851 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-802b5f5c-2a8a-47a0-a373-271569b64ac6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed" status: 200 len: 1317 microversion: 2.1 time: 0.314403 Jan 15 02:44:37.887456 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 265/554] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:37 2021] GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:44:37.940518 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9c77b584-77d0-4eea-a733-c8019d3079d2 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:37.942028 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9c77b584-77d0-4eea-a733-c8019d3079d2 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 333996d9-4a48-440d-bd5f-111d4dddf1a4] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:37.950419 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9c77b584-77d0-4eea-a733-c8019d3079d2 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:37.950935 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9c77b584-77d0-4eea-a733-c8019d3079d2 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:37.951823 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9c77b584-77d0-4eea-a733-c8019d3079d2 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:37.952323 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9c77b584-77d0-4eea-a733-c8019d3079d2 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:38.402091 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-9c77b584-77d0-4eea-a733-c8019d3079d2 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:38.411651 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9c77b584-77d0-4eea-a733-c8019d3079d2 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4" status: 200 len: 1318 microversion: 2.1 time: 0.480556 Jan 15 02:44:38.412250 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 290/555] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:37 2021] GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4 => generated 1318 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:38.558472 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-529d3aed-9f04-4edf-92ad-d1ac94808676 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:38.559146 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-529d3aed-9f04-4edf-92ad-d1ac94808676 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:38.568772 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-529d3aed-9f04-4edf-92ad-d1ac94808676 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:38.569474 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-529d3aed-9f04-4edf-92ad-d1ac94808676 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:38.569992 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-529d3aed-9f04-4edf-92ad-d1ac94808676 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:38.570504 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-529d3aed-9f04-4edf-92ad-d1ac94808676 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:38.737358 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-f11f6673-0ef4-41eb-95b4-38159e4d2bd1 req-592f4ccc-d6b8-41e3-8cb9-84e81d8c8caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "813b0cda-aa4a-4e8d-a4c7-2042b9415e81", "name": "network-vif-plugged", "status": "completed", "tag": "6e4e5bd0-fe30-49a1-b6cb-89dcd970bde9"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:38.744980 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:44:38.744980 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:44:38.754561 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-f11f6673-0ef4-41eb-95b4-38159e4d2bd1 req-592f4ccc-d6b8-41e3-8cb9-84e81d8c8caf service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:38.755175 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-f11f6673-0ef4-41eb-95b4-38159e4d2bd1 req-592f4ccc-d6b8-41e3-8cb9-84e81d8c8caf service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:38.774837 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-f11f6673-0ef4-41eb-95b4-38159e4d2bd1 req-592f4ccc-d6b8-41e3-8cb9-84e81d8c8caf service nova] Creating event network-vif-plugged:6e4e5bd0-fe30-49a1-b6cb-89dcd970bde9 for instance 813b0cda-aa4a-4e8d-a4c7-2042b9415e81 on hv-cinder-76330 Jan 15 02:44:38.780094 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-f11f6673-0ef4-41eb-95b4-38159e4d2bd1 req-592f4ccc-d6b8-41e3-8cb9-84e81d8c8caf service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052903 Jan 15 02:44:38.781057 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 291/556] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:44:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:44:38.809322 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-eb7d12eb-4437-4623-8af1-7de20f6f71d6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:38.810105 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-eb7d12eb-4437-4623-8af1-7de20f6f71d6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:38.818548 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eb7d12eb-4437-4623-8af1-7de20f6f71d6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:38.819105 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eb7d12eb-4437-4623-8af1-7de20f6f71d6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:38.819910 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eb7d12eb-4437-4623-8af1-7de20f6f71d6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:38.820397 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eb7d12eb-4437-4623-8af1-7de20f6f71d6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:38.841789 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-529d3aed-9f04-4edf-92ad-d1ac94808676 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:38.859050 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-529d3aed-9f04-4edf-92ad-d1ac94808676 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:38.868559 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-529d3aed-9f04-4edf-92ad-d1ac94808676 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:38.870523 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-529d3aed-9f04-4edf-92ad-d1ac94808676 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1407 microversion: 2.20 time: 0.322651 Jan 15 02:44:38.871317 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 266/557] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:44:38 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1407 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:44:38.912507 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d40e0065-df06-47bd-b870-36ec9f456bb6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:38.913210 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d40e0065-df06-47bd-b870-36ec9f456bb6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: d6f5f889-a811-42cd-915e-ecaa5ac5b1ed] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:38.921420 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d40e0065-df06-47bd-b870-36ec9f456bb6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:38.921921 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d40e0065-df06-47bd-b870-36ec9f456bb6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:38.922762 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d40e0065-df06-47bd-b870-36ec9f456bb6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:38.923266 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d40e0065-df06-47bd-b870-36ec9f456bb6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:39.077758 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-eb7d12eb-4437-4623-8af1-7de20f6f71d6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:39.088203 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-eb7d12eb-4437-4623-8af1-7de20f6f71d6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1665 microversion: 2.1 time: 0.289949 Jan 15 02:44:39.088821 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 292/558] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:38 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1665 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:44:39.178573 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d40e0065-df06-47bd-b870-36ec9f456bb6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:39.188008 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d40e0065-df06-47bd-b870-36ec9f456bb6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed" status: 200 len: 1317 microversion: 2.1 time: 0.286650 Jan 15 02:44:39.188618 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 267/559] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:38 2021] GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:39.436491 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-205e51a4-e103-40ae-8a33-d22e4f9889cc tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:39.437236 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-205e51a4-e103-40ae-8a33-d22e4f9889cc tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 333996d9-4a48-440d-bd5f-111d4dddf1a4] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:39.445712 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-205e51a4-e103-40ae-8a33-d22e4f9889cc tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:39.446214 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-205e51a4-e103-40ae-8a33-d22e4f9889cc tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:39.447048 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-205e51a4-e103-40ae-8a33-d22e4f9889cc tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:39.447535 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-205e51a4-e103-40ae-8a33-d22e4f9889cc tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:39.692463 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-205e51a4-e103-40ae-8a33-d22e4f9889cc tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:39.701549 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-205e51a4-e103-40ae-8a33-d22e4f9889cc tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4" status: 200 len: 1508 microversion: 2.1 time: 0.274601 Jan 15 02:44:39.702147 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 293/560] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:39 2021] GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4 => generated 1508 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:39.726280 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1c3b5bee-4609-439c-a3ec-b5794ceb0bdf tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09a60870-1a18-4a30-8ffc-e9e036a01c26", "device": "/dev/sdb"}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:39.727698 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1c3b5bee-4609-439c-a3ec-b5794ceb0bdf tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 333996d9-4a48-440d-bd5f-111d4dddf1a4] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:39.736127 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1c3b5bee-4609-439c-a3ec-b5794ceb0bdf tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:39.736633 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1c3b5bee-4609-439c-a3ec-b5794ceb0bdf tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:39.737509 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1c3b5bee-4609-439c-a3ec-b5794ceb0bdf tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:39.739187 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1c3b5bee-4609-439c-a3ec-b5794ceb0bdf tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:39.895819 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1935d0c5-a6f8-4d5b-a7da-5639fe415daa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:39.896576 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1935d0c5-a6f8-4d5b-a7da-5639fe415daa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:39.905368 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1935d0c5-a6f8-4d5b-a7da-5639fe415daa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:39.906212 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1935d0c5-a6f8-4d5b-a7da-5639fe415daa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:39.906848 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1935d0c5-a6f8-4d5b-a7da-5639fe415daa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:39.907347 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1935d0c5-a6f8-4d5b-a7da-5639fe415daa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:40.172154 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1935d0c5-a6f8-4d5b-a7da-5639fe415daa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:40.195407 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1935d0c5-a6f8-4d5b-a7da-5639fe415daa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:40.204364 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1935d0c5-a6f8-4d5b-a7da-5639fe415daa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:40.205711 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1935d0c5-a6f8-4d5b-a7da-5639fe415daa tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1407 microversion: 2.20 time: 0.319848 Jan 15 02:44:40.211735 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1c3b5bee-4609-439c-a3ec-b5794ceb0bdf tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "POST /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.495256 Jan 15 02:44:40.212694 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 268/561] 10.222.0.37 () {60 vars in 1313 bytes} [Fri Jan 15 02:44:39 2021] POST /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4/os-volume_attachments => generated 194 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:44:40.218495 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 294/562] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:44:39 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1407 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:44:40.232366 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2c2c4942-f579-4201-91eb-b27c8b718c56 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:40.233114 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2c2c4942-f579-4201-91eb-b27c8b718c56 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: d6f5f889-a811-42cd-915e-ecaa5ac5b1ed] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:40.243276 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2c2c4942-f579-4201-91eb-b27c8b718c56 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:40.243521 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2c2c4942-f579-4201-91eb-b27c8b718c56 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:40.244386 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2c2c4942-f579-4201-91eb-b27c8b718c56 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:40.244890 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2c2c4942-f579-4201-91eb-b27c8b718c56 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:40.248759 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b20f0a1e-ee55-4137-a9bb-d676b1c0b3af tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:40.249623 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b20f0a1e-ee55-4137-a9bb-d676b1c0b3af tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:40.260222 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b20f0a1e-ee55-4137-a9bb-d676b1c0b3af tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:40.260742 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b20f0a1e-ee55-4137-a9bb-d676b1c0b3af tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:40.261652 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b20f0a1e-ee55-4137-a9bb-d676b1c0b3af tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:40.262143 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b20f0a1e-ee55-4137-a9bb-d676b1c0b3af tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:40.516877 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-2c2c4942-f579-4201-91eb-b27c8b718c56 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:40.531429 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2c2c4942-f579-4201-91eb-b27c8b718c56 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed" status: 200 len: 1317 microversion: 2.1 time: 0.311581 Jan 15 02:44:40.532479 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 295/563] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:40 2021] GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:40.772464 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b20f0a1e-ee55-4137-a9bb-d676b1c0b3af tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:40.782668 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b20f0a1e-ee55-4137-a9bb-d676b1c0b3af tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1669 microversion: 2.1 time: 0.566888 Jan 15 02:44:40.783234 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 269/564] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:40 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1669 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:41.231518 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3d6ab738-d833-432a-b1af-6f69c056fedc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:41.232271 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3d6ab738-d833-432a-b1af-6f69c056fedc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:41.241426 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3d6ab738-d833-432a-b1af-6f69c056fedc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:41.242004 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3d6ab738-d833-432a-b1af-6f69c056fedc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:41.242908 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3d6ab738-d833-432a-b1af-6f69c056fedc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:41.243430 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3d6ab738-d833-432a-b1af-6f69c056fedc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:41.508376 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3d6ab738-d833-432a-b1af-6f69c056fedc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:41.523474 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3d6ab738-d833-432a-b1af-6f69c056fedc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:41.530132 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3d6ab738-d833-432a-b1af-6f69c056fedc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:41.531344 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3d6ab738-d833-432a-b1af-6f69c056fedc tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1600 microversion: 2.20 time: 0.309281 Jan 15 02:44:41.531931 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 296/565] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:44:41 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1600 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:44:41.556263 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-76c95788-1a55-4222-99c9-e9548088f31c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:41.556809 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-76c95788-1a55-4222-99c9-e9548088f31c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:41.567245 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-aced0a50-3097-4953-b7c5-18ddd4a7d350 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:41.567918 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-aced0a50-3097-4953-b7c5-18ddd4a7d350 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: d6f5f889-a811-42cd-915e-ecaa5ac5b1ed] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:41.578083 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-76c95788-1a55-4222-99c9-e9548088f31c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:41.578630 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-76c95788-1a55-4222-99c9-e9548088f31c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:41.579658 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-76c95788-1a55-4222-99c9-e9548088f31c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:41.580141 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-76c95788-1a55-4222-99c9-e9548088f31c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:41.581742 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-aced0a50-3097-4953-b7c5-18ddd4a7d350 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:41.582261 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-aced0a50-3097-4953-b7c5-18ddd4a7d350 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:41.583130 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-aced0a50-3097-4953-b7c5-18ddd4a7d350 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:41.583618 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-aced0a50-3097-4953-b7c5-18ddd4a7d350 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:41.810700 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-76c95788-1a55-4222-99c9-e9548088f31c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.264169 Jan 15 02:44:41.811347 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 270/566] 10.222.0.37 () {60 vars in 1306 bytes} [Fri Jan 15 02:44:41 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/os-interface => generated 285 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:44:41.879017 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-aced0a50-3097-4953-b7c5-18ddd4a7d350 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:41.888104 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-aced0a50-3097-4953-b7c5-18ddd4a7d350 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed" status: 200 len: 1317 microversion: 2.1 time: 0.329890 Jan 15 02:44:41.889026 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 297/567] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:41 2021] GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:42.913891 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1a5410cd-1b32-4fbc-b261-ee88ecdbe8b2 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:42.914563 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1a5410cd-1b32-4fbc-b261-ee88ecdbe8b2 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: d6f5f889-a811-42cd-915e-ecaa5ac5b1ed] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:42.922552 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1a5410cd-1b32-4fbc-b261-ee88ecdbe8b2 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:42.923058 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1a5410cd-1b32-4fbc-b261-ee88ecdbe8b2 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:42.923889 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1a5410cd-1b32-4fbc-b261-ee88ecdbe8b2 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:42.924388 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1a5410cd-1b32-4fbc-b261-ee88ecdbe8b2 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:43.617665 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1a5410cd-1b32-4fbc-b261-ee88ecdbe8b2 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:43.629131 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1a5410cd-1b32-4fbc-b261-ee88ecdbe8b2 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed" status: 200 len: 1317 microversion: 2.1 time: 0.724186 Jan 15 02:44:43.639765 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 271/568] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:42 2021] GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed => generated 1317 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:43.935884 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-834ffcb6-e75d-4eac-b1ba-a7a0ef3edc73 req-0e27a819-3cc3-45a7-a6ee-60e33a19ca5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "813b0cda-aa4a-4e8d-a4c7-2042b9415e81", "tag": "6e4e5bd0-fe30-49a1-b6cb-89dcd970bde9"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:43.938986 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2b9f77ba-2734-45e7-bbe6-1fb3fc565c20 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:43.946623 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:44:43.946623 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:44:43.950292 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2b9f77ba-2734-45e7-bbe6-1fb3fc565c20 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:43.959913 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2b9f77ba-2734-45e7-bbe6-1fb3fc565c20 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:43.960438 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2b9f77ba-2734-45e7-bbe6-1fb3fc565c20 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:43.961370 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2b9f77ba-2734-45e7-bbe6-1fb3fc565c20 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:43.961833 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-834ffcb6-e75d-4eac-b1ba-a7a0ef3edc73 req-0e27a819-3cc3-45a7-a6ee-60e33a19ca5d service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:43.962019 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2b9f77ba-2734-45e7-bbe6-1fb3fc565c20 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:43.962348 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-834ffcb6-e75d-4eac-b1ba-a7a0ef3edc73 req-0e27a819-3cc3-45a7-a6ee-60e33a19ca5d service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:43.980967 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-834ffcb6-e75d-4eac-b1ba-a7a0ef3edc73 req-0e27a819-3cc3-45a7-a6ee-60e33a19ca5d service nova] Creating event network-changed:6e4e5bd0-fe30-49a1-b6cb-89dcd970bde9 for instance 813b0cda-aa4a-4e8d-a4c7-2042b9415e81 on hv-cinder-76330 Jan 15 02:44:43.986431 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-834ffcb6-e75d-4eac-b1ba-a7a0ef3edc73 req-0e27a819-3cc3-45a7-a6ee-60e33a19ca5d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059614 Jan 15 02:44:43.987328 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 272/569] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:44:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:44:44.100572 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2b9f77ba-2734-45e7-bbe6-1fb3fc565c20 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 14 microversion: 2.20 time: 0.182611 Jan 15 02:44:44.106271 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 298/570] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:44:43 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:44.588534 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-dfe82148-bb38-4f99-aae3-c39405ed0c04 req-7d11c3be-4f7a-41ab-9d43-ef9dbfd60715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f5f889-a811-42cd-915e-ecaa5ac5b1ed", "name": "network-vif-plugged", "status": "completed", "tag": "72ec9465-1f3d-446b-b264-6927708f49da"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:44.595532 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:44:44.595532 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:44:44.605638 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-dfe82148-bb38-4f99-aae3-c39405ed0c04 req-7d11c3be-4f7a-41ab-9d43-ef9dbfd60715 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:44.606301 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-dfe82148-bb38-4f99-aae3-c39405ed0c04 req-7d11c3be-4f7a-41ab-9d43-ef9dbfd60715 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:44.626625 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-dfe82148-bb38-4f99-aae3-c39405ed0c04 req-7d11c3be-4f7a-41ab-9d43-ef9dbfd60715 service nova] Creating event network-vif-plugged:72ec9465-1f3d-446b-b264-6927708f49da for instance d6f5f889-a811-42cd-915e-ecaa5ac5b1ed on hv-cinder-76330 Jan 15 02:44:44.632933 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-dfe82148-bb38-4f99-aae3-c39405ed0c04 req-7d11c3be-4f7a-41ab-9d43-ef9dbfd60715 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053905 Jan 15 02:44:44.636928 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 273/571] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:44:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:44:44.661292 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-fb299eed-3a99-42e2-ad0c-d8b2f8baef76 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:44.663318 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-fb299eed-3a99-42e2-ad0c-d8b2f8baef76 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: d6f5f889-a811-42cd-915e-ecaa5ac5b1ed] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:44.677499 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fb299eed-3a99-42e2-ad0c-d8b2f8baef76 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:44.692651 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fb299eed-3a99-42e2-ad0c-d8b2f8baef76 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:44.696220 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fb299eed-3a99-42e2-ad0c-d8b2f8baef76 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:44.696347 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fb299eed-3a99-42e2-ad0c-d8b2f8baef76 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:45.121467 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a6161614-017e-40cd-9b25-185915a69089 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:45.122724 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a6161614-017e-40cd-9b25-185915a69089 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:45.132126 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a6161614-017e-40cd-9b25-185915a69089 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:45.132728 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a6161614-017e-40cd-9b25-185915a69089 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:45.133829 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a6161614-017e-40cd-9b25-185915a69089 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:45.134393 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a6161614-017e-40cd-9b25-185915a69089 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:45.305264 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-fb299eed-3a99-42e2-ad0c-d8b2f8baef76 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:45.314532 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-fb299eed-3a99-42e2-ad0c-d8b2f8baef76 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed" status: 200 len: 1317 microversion: 2.1 time: 0.671376 Jan 15 02:44:45.315145 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 299/572] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:44 2021] GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed => generated 1317 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:45.442368 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a6161614-017e-40cd-9b25-185915a69089 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 14 microversion: 2.20 time: 0.331161 Jan 15 02:44:45.443088 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 274/573] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:44:45 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 14 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:44:46.339851 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-de1231c1-d3ef-4650-b75e-10bf1476bee1 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:46.340525 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-de1231c1-d3ef-4650-b75e-10bf1476bee1 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: d6f5f889-a811-42cd-915e-ecaa5ac5b1ed] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:46.350040 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-de1231c1-d3ef-4650-b75e-10bf1476bee1 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:46.350547 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-de1231c1-d3ef-4650-b75e-10bf1476bee1 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:46.351395 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-de1231c1-d3ef-4650-b75e-10bf1476bee1 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:46.351884 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-de1231c1-d3ef-4650-b75e-10bf1476bee1 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:46.461232 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a1aad2ef-cb2f-4092-8b38-04095cf8e5ec tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:46.462398 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a1aad2ef-cb2f-4092-8b38-04095cf8e5ec tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:46.471357 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a1aad2ef-cb2f-4092-8b38-04095cf8e5ec tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:46.472470 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a1aad2ef-cb2f-4092-8b38-04095cf8e5ec tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:46.473417 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a1aad2ef-cb2f-4092-8b38-04095cf8e5ec tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:46.473918 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a1aad2ef-cb2f-4092-8b38-04095cf8e5ec tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:46.616756 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-de1231c1-d3ef-4650-b75e-10bf1476bee1 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:46.626707 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-de1231c1-d3ef-4650-b75e-10bf1476bee1 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed" status: 200 len: 1317 microversion: 2.1 time: 0.296841 Jan 15 02:44:46.627757 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 300/574] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:46 2021] GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:46.782852 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a1aad2ef-cb2f-4092-8b38-04095cf8e5ec tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 14 microversion: 2.20 time: 0.332086 Jan 15 02:44:46.783849 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 275/575] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:44:46 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 14 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:44:47.653222 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d0898436-35fb-4045-b2f8-675b60548adf tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:44:47.653826 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d0898436-35fb-4045-b2f8-675b60548adf tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: d6f5f889-a811-42cd-915e-ecaa5ac5b1ed] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:47.664000 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d0898436-35fb-4045-b2f8-675b60548adf tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:47.664517 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d0898436-35fb-4045-b2f8-675b60548adf tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:47.665434 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d0898436-35fb-4045-b2f8-675b60548adf tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:47.665905 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d0898436-35fb-4045-b2f8-675b60548adf tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:47.801602 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-fb7c0553-63a9-4147-9ae1-95cc6e4a7406 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:47.802769 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-fb7c0553-63a9-4147-9ae1-95cc6e4a7406 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:47.811491 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fb7c0553-63a9-4147-9ae1-95cc6e4a7406 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:47.812718 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fb7c0553-63a9-4147-9ae1-95cc6e4a7406 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:47.813606 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fb7c0553-63a9-4147-9ae1-95cc6e4a7406 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:47.814249 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fb7c0553-63a9-4147-9ae1-95cc6e4a7406 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:47.923612 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d0898436-35fb-4045-b2f8-675b60548adf tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:44:47.933153 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d0898436-35fb-4045-b2f8-675b60548adf tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed" status: 200 len: 1507 microversion: 2.1 time: 0.291245 Jan 15 02:44:47.933769 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 301/576] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:44:47 2021] GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed => generated 1507 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:47.955034 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-fb7c0553-63a9-4147-9ae1-95cc6e4a7406 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 14 microversion: 2.20 time: 0.163638 Jan 15 02:44:47.956791 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 276/577] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:44:47 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 14 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:44:48.973423 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7f752ba4-c91f-44e8-8e7d-f4f38b3f5109 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:48.974480 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-7f752ba4-c91f-44e8-8e7d-f4f38b3f5109 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:48.982940 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7f752ba4-c91f-44e8-8e7d-f4f38b3f5109 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:48.983456 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7f752ba4-c91f-44e8-8e7d-f4f38b3f5109 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:48.984304 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7f752ba4-c91f-44e8-8e7d-f4f38b3f5109 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:48.984799 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7f752ba4-c91f-44e8-8e7d-f4f38b3f5109 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:49.543467 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7b118810-7350-46ab-ac1c-01165c30c700 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0d1d95b-be27-4a9a-82c1-c4705f77558b"}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:49.544776 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-7b118810-7350-46ab-ac1c-01165c30c700 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: d6f5f889-a811-42cd-915e-ecaa5ac5b1ed] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:49.553694 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7b118810-7350-46ab-ac1c-01165c30c700 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:49.554205 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7b118810-7350-46ab-ac1c-01165c30c700 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:49.555039 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7b118810-7350-46ab-ac1c-01165c30c700 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:49.555540 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7b118810-7350-46ab-ac1c-01165c30c700 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:51.990681 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-7f752ba4-c91f-44e8-8e7d-f4f38b3f5109 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 14 microversion: 2.20 time: 3.026750 Jan 15 02:44:51.992145 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 302/578] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:44:48 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 14 bytes in 3029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:52.162850 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-7b118810-7350-46ab-ac1c-01165c30c700 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "POST /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.630131 Jan 15 02:44:52.163598 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 277/579] 10.222.0.37 () {60 vars in 1313 bytes} [Fri Jan 15 02:44:49 2021] POST /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed/os-volume_attachments => generated 194 bytes in 2632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:44:53.009229 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6c27e56c-1109-43fe-9120-1eb9948b708c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:53.010954 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6c27e56c-1109-43fe-9120-1eb9948b708c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:53.019773 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6c27e56c-1109-43fe-9120-1eb9948b708c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:53.020306 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6c27e56c-1109-43fe-9120-1eb9948b708c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:53.021166 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6c27e56c-1109-43fe-9120-1eb9948b708c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:53.021698 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6c27e56c-1109-43fe-9120-1eb9948b708c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:53.181371 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6c27e56c-1109-43fe-9120-1eb9948b708c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 14 microversion: 2.20 time: 0.182501 Jan 15 02:44:53.182210 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 303/580] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:44:52 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 14 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:54.200210 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a37c2569-9232-466b-a1f8-9980ace40c34 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:54.201316 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a37c2569-9232-466b-a1f8-9980ace40c34 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:54.210027 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a37c2569-9232-466b-a1f8-9980ace40c34 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:54.210544 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a37c2569-9232-466b-a1f8-9980ace40c34 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:54.211383 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a37c2569-9232-466b-a1f8-9980ace40c34 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:54.211871 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a37c2569-9232-466b-a1f8-9980ace40c34 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:56.315881 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a37c2569-9232-466b-a1f8-9980ace40c34 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 14 microversion: 2.20 time: 2.126330 Jan 15 02:44:56.316668 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 278/581] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:44:54 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 14 bytes in 2128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:57.334092 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e96139d3-4c91-4910-91c5-b6a06064d4ce tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:57.335157 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e96139d3-4c91-4910-91c5-b6a06064d4ce tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:57.343865 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e96139d3-4c91-4910-91c5-b6a06064d4ce tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:57.344377 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e96139d3-4c91-4910-91c5-b6a06064d4ce tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:57.345261 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e96139d3-4c91-4910-91c5-b6a06064d4ce tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:57.345761 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e96139d3-4c91-4910-91c5-b6a06064d4ce tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:57.503924 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e96139d3-4c91-4910-91c5-b6a06064d4ce tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 14 microversion: 2.20 time: 0.179510 Jan 15 02:44:57.504401 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 304/582] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:44:57 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 14 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:58.522252 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6297b5b1-04a5-4364-b057-23a36df6bed3 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:58.523564 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6297b5b1-04a5-4364-b057-23a36df6bed3 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:58.532137 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6297b5b1-04a5-4364-b057-23a36df6bed3 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:58.532636 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6297b5b1-04a5-4364-b057-23a36df6bed3 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:58.533496 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6297b5b1-04a5-4364-b057-23a36df6bed3 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:58.533989 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6297b5b1-04a5-4364-b057-23a36df6bed3 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:58.688311 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6297b5b1-04a5-4364-b057-23a36df6bed3 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 14 microversion: 2.20 time: 0.175872 Jan 15 02:44:58.689077 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 279/583] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:44:58 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:44:59.706340 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b963add2-b31f-43cc-bf87-79389826df41 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:44:59.708701 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b963add2-b31f-43cc-bf87-79389826df41 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:44:59.717486 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b963add2-b31f-43cc-bf87-79389826df41 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:59.718006 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b963add2-b31f-43cc-bf87-79389826df41 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:59.718852 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b963add2-b31f-43cc-bf87-79389826df41 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:44:59.719352 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b963add2-b31f-43cc-bf87-79389826df41 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:44:59.874990 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b963add2-b31f-43cc-bf87-79389826df41 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 8041 microversion: 2.20 time: 0.178150 Jan 15 02:44:59.875622 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 305/584] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:44:59 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 8041 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:45:00.651660 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7ea4fa36-22ba-4d53-b55d-ffe6af3626a3 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:00.652323 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-7ea4fa36-22ba-4d53-b55d-ffe6af3626a3 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 333996d9-4a48-440d-bd5f-111d4dddf1a4] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:00.661536 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7ea4fa36-22ba-4d53-b55d-ffe6af3626a3 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:00.662055 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7ea4fa36-22ba-4d53-b55d-ffe6af3626a3 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:00.662924 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7ea4fa36-22ba-4d53-b55d-ffe6af3626a3 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:00.663417 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7ea4fa36-22ba-4d53-b55d-ffe6af3626a3 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:00.894944 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-678f1866-fa92-4397-b6a3-b2aa0e65c9e8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:00.896152 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-678f1866-fa92-4397-b6a3-b2aa0e65c9e8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:00.906051 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-678f1866-fa92-4397-b6a3-b2aa0e65c9e8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:00.906775 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-678f1866-fa92-4397-b6a3-b2aa0e65c9e8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:00.907642 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-678f1866-fa92-4397-b6a3-b2aa0e65c9e8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:00.908136 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-678f1866-fa92-4397-b6a3-b2aa0e65c9e8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:00.950489 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-7ea4fa36-22ba-4d53-b55d-ffe6af3626a3 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "DELETE /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4/os-volume_attachments/09a60870-1a18-4a30-8ffc-e9e036a01c26" status: 202 len: 0 microversion: 2.1 time: 0.309500 Jan 15 02:45:00.951197 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 280/585] 10.222.0.37 () {58 vars in 1406 bytes} [Fri Jan 15 02:45:00 2021] DELETE /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4/os-volume_attachments/09a60870-1a18-4a30-8ffc-e9e036a01c26 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 02:45:01.079886 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-678f1866-fa92-4397-b6a3-b2aa0e65c9e8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 15025 microversion: 2.20 time: 0.195592 Jan 15 02:45:01.080584 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 306/586] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:00 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 15025 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 02:45:02.100515 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-430f1676-5856-48e4-8137-d97df24f08a6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:02.101699 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-430f1676-5856-48e4-8137-d97df24f08a6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:02.110099 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-430f1676-5856-48e4-8137-d97df24f08a6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:02.110606 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-430f1676-5856-48e4-8137-d97df24f08a6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:02.111454 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-430f1676-5856-48e4-8137-d97df24f08a6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:02.111952 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-430f1676-5856-48e4-8137-d97df24f08a6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:02.289032 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-430f1676-5856-48e4-8137-d97df24f08a6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 17933 microversion: 2.20 time: 0.199638 Jan 15 02:45:02.289757 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 281/587] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:02 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 17933 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:03.308028 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6b4fd583-05f7-4371-a3bb-6e60e8fd78b6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:03.309407 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6b4fd583-05f7-4371-a3bb-6e60e8fd78b6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:03.318980 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6b4fd583-05f7-4371-a3bb-6e60e8fd78b6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:03.319503 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6b4fd583-05f7-4371-a3bb-6e60e8fd78b6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:03.320384 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6b4fd583-05f7-4371-a3bb-6e60e8fd78b6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:03.320879 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6b4fd583-05f7-4371-a3bb-6e60e8fd78b6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:03.394674 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5f0c2d6c-0967-4038-96b9-fabfc32c2814 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0d1d95b-be27-4a9a-82c1-c4705f77558b"}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:03.396655 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5f0c2d6c-0967-4038-96b9-fabfc32c2814 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: d6f5f889-a811-42cd-915e-ecaa5ac5b1ed] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:03.406025 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5f0c2d6c-0967-4038-96b9-fabfc32c2814 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:03.406547 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5f0c2d6c-0967-4038-96b9-fabfc32c2814 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:03.407395 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5f0c2d6c-0967-4038-96b9-fabfc32c2814 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:03.407882 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5f0c2d6c-0967-4038-96b9-fabfc32c2814 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:03.479090 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6b4fd583-05f7-4371-a3bb-6e60e8fd78b6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 18030 microversion: 2.20 time: 0.180856 Jan 15 02:45:03.480167 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 307/588] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:03 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 18030 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:03.483834 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-5f0c2d6c-0967-4038-96b9-fabfc32c2814 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] HTTP exception thrown: Invalid volume: volume c0d1d95b-be27-4a9a-82c1-c4705f77558b already attached Jan 15 02:45:03.484503 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5f0c2d6c-0967-4038-96b9-fabfc32c2814 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Returning 400 to user: Invalid volume: volume c0d1d95b-be27-4a9a-82c1-c4705f77558b already attached {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:45:03.485431 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5f0c2d6c-0967-4038-96b9-fabfc32c2814 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "POST /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed/os-volume_attachments" status: 400 len: 120 microversion: 2.1 time: 0.100767 Jan 15 02:45:03.486060 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 282/589] 10.222.0.37 () {60 vars in 1313 bytes} [Fri Jan 15 02:45:03 2021] POST /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed/os-volume_attachments => generated 120 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 02:45:03.611443 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e36fced9-7303-432c-8159-e397ae8b7577 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:03.612103 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e36fced9-7303-432c-8159-e397ae8b7577 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: d6f5f889-a811-42cd-915e-ecaa5ac5b1ed] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:03.622241 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e36fced9-7303-432c-8159-e397ae8b7577 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:03.622796 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e36fced9-7303-432c-8159-e397ae8b7577 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:03.623733 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e36fced9-7303-432c-8159-e397ae8b7577 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:03.624235 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e36fced9-7303-432c-8159-e397ae8b7577 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:03.919579 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e36fced9-7303-432c-8159-e397ae8b7577 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "DELETE /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed/os-volume_attachments/c0d1d95b-be27-4a9a-82c1-c4705f77558b" status: 202 len: 0 microversion: 2.1 time: 0.317996 Jan 15 02:45:03.920226 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 308/590] 10.222.0.37 () {58 vars in 1406 bytes} [Fri Jan 15 02:45:03 2021] DELETE /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed/os-volume_attachments/c0d1d95b-be27-4a9a-82c1-c4705f77558b => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:04.402072 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-55daf50b-a7e9-4b4c-94b7-78858950be62 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:04.402715 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-55daf50b-a7e9-4b4c-94b7-78858950be62 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 333996d9-4a48-440d-bd5f-111d4dddf1a4] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:04.412215 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-55daf50b-a7e9-4b4c-94b7-78858950be62 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:04.412739 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-55daf50b-a7e9-4b4c-94b7-78858950be62 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:04.413654 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-55daf50b-a7e9-4b4c-94b7-78858950be62 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:04.414157 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-55daf50b-a7e9-4b4c-94b7-78858950be62 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:04.492988 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-55daf50b-a7e9-4b4c-94b7-78858950be62 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 333996d9-4a48-440d-bd5f-111d4dddf1a4] Going to try to terminate instance {{(pid=94112) delete /opt/stack/nova/nova/compute/api.py:2535}} Jan 15 02:45:04.510538 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a719dee1-1d8f-42b3-8f1e-bd979ad913fe tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:04.512879 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a719dee1-1d8f-42b3-8f1e-bd979ad913fe tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:04.530234 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a719dee1-1d8f-42b3-8f1e-bd979ad913fe tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:04.531171 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a719dee1-1d8f-42b3-8f1e-bd979ad913fe tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:04.532731 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a719dee1-1d8f-42b3-8f1e-bd979ad913fe tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:04.533710 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a719dee1-1d8f-42b3-8f1e-bd979ad913fe tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:04.668190 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-55daf50b-a7e9-4b4c-94b7-78858950be62 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "DELETE /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4" status: 204 len: 0 microversion: 2.1 time: 0.274657 Jan 15 02:45:04.669529 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 283/591] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:45:04 2021] DELETE /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 02:45:04.699512 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-60b9835c-176d-4c8d-9911-7024cec1bded tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:04.700933 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-60b9835c-176d-4c8d-9911-7024cec1bded tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 333996d9-4a48-440d-bd5f-111d4dddf1a4] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:04.717849 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-60b9835c-176d-4c8d-9911-7024cec1bded tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:04.718806 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-60b9835c-176d-4c8d-9911-7024cec1bded tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:04.720373 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-60b9835c-176d-4c8d-9911-7024cec1bded tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:04.721357 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-60b9835c-176d-4c8d-9911-7024cec1bded tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:04.845216 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a719dee1-1d8f-42b3-8f1e-bd979ad913fe tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 20996 microversion: 2.20 time: 0.356173 Jan 15 02:45:04.846819 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 309/592] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:04 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 20996 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:05.076533 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-60b9835c-176d-4c8d-9911-7024cec1bded tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:05.096403 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-60b9835c-176d-4c8d-9911-7024cec1bded tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4" status: 200 len: 1514 microversion: 2.1 time: 0.418567 Jan 15 02:45:05.097608 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 284/593] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:04 2021] GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4 => generated 1514 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:05.868126 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-25b997d0-f051-445d-85f0-7d6a1d073fa8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:05.869375 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-25b997d0-f051-445d-85f0-7d6a1d073fa8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:05.878994 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-25b997d0-f051-445d-85f0-7d6a1d073fa8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:05.879485 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-25b997d0-f051-445d-85f0-7d6a1d073fa8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:05.880370 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-25b997d0-f051-445d-85f0-7d6a1d073fa8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:05.880871 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-25b997d0-f051-445d-85f0-7d6a1d073fa8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:06.040433 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-25b997d0-f051-445d-85f0-7d6a1d073fa8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 22167 microversion: 2.20 time: 0.183693 Jan 15 02:45:06.042067 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 310/594] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:05 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 22167 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 02:45:06.124942 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f22d584c-ecc7-41ca-afb3-36b66f19d5fe tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:06.125637 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f22d584c-ecc7-41ca-afb3-36b66f19d5fe tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 333996d9-4a48-440d-bd5f-111d4dddf1a4] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:06.134136 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f22d584c-ecc7-41ca-afb3-36b66f19d5fe tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:06.134774 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f22d584c-ecc7-41ca-afb3-36b66f19d5fe tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:06.135644 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f22d584c-ecc7-41ca-afb3-36b66f19d5fe tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:06.136134 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f22d584c-ecc7-41ca-afb3-36b66f19d5fe tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:06.377688 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-32a3b188-3978-4dc9-8c91-3bc821318a14 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-410813646", "imageRef": "1807a1cb-835d-4a56-8751-82ffa40b12c9", "flavorRef": "452", "networks": [{"uuid": "570f6e31-1bda-4ebb-b8b9-ce9a0b49f0a4"}]}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:06.453995 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f22d584c-ecc7-41ca-afb3-36b66f19d5fe tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:06.467389 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f22d584c-ecc7-41ca-afb3-36b66f19d5fe tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4" status: 200 len: 1514 microversion: 2.1 time: 0.352847 Jan 15 02:45:06.468004 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 285/595] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:06 2021] GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4 => generated 1514 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:45:06.475458 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-32a3b188-3978-4dc9-8c91-3bc821318a14 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] validate_networks() for [('570f6e31-1bda-4ebb-b8b9-ce9a0b49f0a4', None, None, None)] {{(pid=94111) validate_networks /opt/stack/nova/nova/network/neutron.py:2340}} Jan 15 02:45:07.058601 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-63fdb407-f436-4d7c-8b6e-40ac88dca9f7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:07.059745 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-63fdb407-f436-4d7c-8b6e-40ac88dca9f7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:07.069443 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-63fdb407-f436-4d7c-8b6e-40ac88dca9f7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:07.069961 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-63fdb407-f436-4d7c-8b6e-40ac88dca9f7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:07.070831 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-63fdb407-f436-4d7c-8b6e-40ac88dca9f7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:07.071326 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-63fdb407-f436-4d7c-8b6e-40ac88dca9f7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:07.154557 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-32a3b188-3978-4dc9-8c91-3bc821318a14 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Flavor limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 02:45:07.155036 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-32a3b188-3978-4dc9-8c91-3bc821318a14 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Image limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Jan 15 02:45:07.155586 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-32a3b188-3978-4dc9-8c91-3bc821318a14 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Flavor pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 02:45:07.156055 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-32a3b188-3978-4dc9-8c91-3bc821318a14 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Image pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Jan 15 02:45:07.156523 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-32a3b188-3978-4dc9-8c91-3bc821318a14 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Jan 15 02:45:07.166637 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-32a3b188-3978-4dc9-8c91-3bc821318a14 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:07.167153 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-32a3b188-3978-4dc9-8c91-3bc821318a14 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:07.168045 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-32a3b188-3978-4dc9-8c91-3bc821318a14 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:07.168575 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-32a3b188-3978-4dc9-8c91-3bc821318a14 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:07.189733 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-32a3b188-3978-4dc9-8c91-3bc821318a14 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Getting quotas for project dd56ed8011104bf0a99ad88d8911ead9. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:45:07.195433 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-32a3b188-3978-4dc9-8c91-3bc821318a14 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Getting quotas for user 63160ec41a3b4c9e839a6aefe3c269d0 and project dd56ed8011104bf0a99ad88d8911ead9. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:45:07.207809 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-32a3b188-3978-4dc9-8c91-3bc821318a14 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Going to run 1 instances... {{(pid=94111) _provision_instances /opt/stack/nova/nova/compute/api.py:1263}} Jan 15 02:45:07.211630 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-32a3b188-3978-4dc9-8c91-3bc821318a14 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 7c7210e0-e5b6-4e95-9913-cc36e1f3b666] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1807a1cb-835d-4a56-8751-82ffa40b12c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1661}} Jan 15 02:45:07.263319 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-63fdb407-f436-4d7c-8b6e-40ac88dca9f7 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 23232 microversion: 2.20 time: 0.214518 Jan 15 02:45:07.264303 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 286/596] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:07 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 23232 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 02:45:07.266311 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-32a3b188-3978-4dc9-8c91-3bc821318a14 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.898741 Jan 15 02:45:07.267494 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 311/597] 10.222.0.37 () {60 vars in 1137 bytes} [Fri Jan 15 02:45:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 02:45:07.285209 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ea3dad97-0c6d-4858-97a4-7575c6fb9841 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:07.286481 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ea3dad97-0c6d-4858-97a4-7575c6fb9841 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 7c7210e0-e5b6-4e95-9913-cc36e1f3b666] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:07.387008 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-ea3dad97-0c6d-4858-97a4-7575c6fb9841 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:07.402758 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ea3dad97-0c6d-4858-97a4-7575c6fb9841 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666" status: 200 len: 1217 microversion: 2.1 time: 0.127301 Jan 15 02:45:07.403831 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 287/598] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:07 2021] GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666 => generated 1217 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:07.510983 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d585aef3-99d4-4a83-8137-705bbfbce3f4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:07.511684 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d585aef3-99d4-4a83-8137-705bbfbce3f4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 333996d9-4a48-440d-bd5f-111d4dddf1a4] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:07.521991 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d585aef3-99d4-4a83-8137-705bbfbce3f4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:07.522504 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d585aef3-99d4-4a83-8137-705bbfbce3f4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:07.523927 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d585aef3-99d4-4a83-8137-705bbfbce3f4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:07.524135 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d585aef3-99d4-4a83-8137-705bbfbce3f4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:08.007788 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d585aef3-99d4-4a83-8137-705bbfbce3f4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:08.018307 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d585aef3-99d4-4a83-8137-705bbfbce3f4 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4" status: 200 len: 1514 microversion: 2.1 time: 0.517719 Jan 15 02:45:08.018947 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 312/599] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:07 2021] GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4 => generated 1514 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:08.283485 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-72f837b3-3a8f-4fb3-83bc-ac2d2ec9bdcb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:08.284531 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-72f837b3-3a8f-4fb3-83bc-ac2d2ec9bdcb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:08.294034 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-72f837b3-3a8f-4fb3-83bc-ac2d2ec9bdcb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:08.294557 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-72f837b3-3a8f-4fb3-83bc-ac2d2ec9bdcb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:08.295386 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-72f837b3-3a8f-4fb3-83bc-ac2d2ec9bdcb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:08.295875 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-72f837b3-3a8f-4fb3-83bc-ac2d2ec9bdcb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:08.436666 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6f9dcaf9-f9f0-4fe9-a7df-825c3e8dc103 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:08.437435 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6f9dcaf9-f9f0-4fe9-a7df-825c3e8dc103 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 7c7210e0-e5b6-4e95-9913-cc36e1f3b666] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:08.447501 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6f9dcaf9-f9f0-4fe9-a7df-825c3e8dc103 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:08.448021 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6f9dcaf9-f9f0-4fe9-a7df-825c3e8dc103 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:08.449185 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6f9dcaf9-f9f0-4fe9-a7df-825c3e8dc103 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:08.449752 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6f9dcaf9-f9f0-4fe9-a7df-825c3e8dc103 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:08.451020 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-72f837b3-3a8f-4fb3-83bc-ac2d2ec9bdcb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 24664 microversion: 2.20 time: 0.176684 Jan 15 02:45:08.452764 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 288/600] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:08 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 24664 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:08.658531 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6f9dcaf9-f9f0-4fe9-a7df-825c3e8dc103 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:08.671028 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6f9dcaf9-f9f0-4fe9-a7df-825c3e8dc103 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666" status: 200 len: 1269 microversion: 2.1 time: 0.244228 Jan 15 02:45:08.672264 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 313/601] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:08 2021] GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666 => generated 1269 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:08.867917 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-7859f449-d26d-480b-a193-7e2a1dcce178 req-e8445575-f4db-4c63-9bdb-0b4060e0e098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "333996d9-4a48-440d-bd5f-111d4dddf1a4", "name": "network-vif-deleted", "tag": "5606fd40-58f7-4a3a-ba68-db04deb9c4ac"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:08.885907 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:45:08.885907 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:45:08.905779 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-7859f449-d26d-480b-a193-7e2a1dcce178 req-e8445575-f4db-4c63-9bdb-0b4060e0e098 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:08.906635 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-7859f449-d26d-480b-a193-7e2a1dcce178 req-e8445575-f4db-4c63-9bdb-0b4060e0e098 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:08.947694 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-7859f449-d26d-480b-a193-7e2a1dcce178 req-e8445575-f4db-4c63-9bdb-0b4060e0e098 service nova] Creating event network-vif-deleted:5606fd40-58f7-4a3a-ba68-db04deb9c4ac for instance 333996d9-4a48-440d-bd5f-111d4dddf1a4 on hv-cinder-76330 Jan 15 02:45:08.953849 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-7859f449-d26d-480b-a193-7e2a1dcce178 req-e8445575-f4db-4c63-9bdb-0b4060e0e098 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208388 Jan 15 02:45:08.954887 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 289/602] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:45:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:45:09.044916 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-aa52a19f-430e-4c4c-b16b-10099d59f630 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:09.045658 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-aa52a19f-430e-4c4c-b16b-10099d59f630 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 333996d9-4a48-440d-bd5f-111d4dddf1a4] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:09.055150 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-aa52a19f-430e-4c4c-b16b-10099d59f630 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:09.055676 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-aa52a19f-430e-4c4c-b16b-10099d59f630 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:09.056530 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-aa52a19f-430e-4c4c-b16b-10099d59f630 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:09.057704 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-aa52a19f-430e-4c4c-b16b-10099d59f630 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:09.147309 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-aa52a19f-430e-4c4c-b16b-10099d59f630 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:09.148160 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-aa52a19f-430e-4c4c-b16b-10099d59f630 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:09.148688 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.objects.instance [None req-aa52a19f-430e-4c4c-b16b-10099d59f630 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lazy-loading 'fault' on Instance uuid 333996d9-4a48-440d-bd5f-111d4dddf1a4 {{(pid=94111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Jan 15 02:45:09.235475 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-aa52a19f-430e-4c4c-b16b-10099d59f630 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995863afc2c1475593bef164d921400f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021678626dd143d687a9bf2afee638a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:09.245283 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-aa52a19f-430e-4c4c-b16b-10099d59f630 tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4" status: 200 len: 1308 microversion: 2.1 time: 0.210571 Jan 15 02:45:09.245871 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 314/603] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:09 2021] GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4 => generated 1308 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:09.470166 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9b6e7b26-40e8-4e2d-a829-73674785f349 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:09.471207 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9b6e7b26-40e8-4e2d-a829-73674785f349 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:09.480744 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9b6e7b26-40e8-4e2d-a829-73674785f349 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:09.481280 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9b6e7b26-40e8-4e2d-a829-73674785f349 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:09.482128 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9b6e7b26-40e8-4e2d-a829-73674785f349 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:09.482610 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9b6e7b26-40e8-4e2d-a829-73674785f349 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:09.651458 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9b6e7b26-40e8-4e2d-a829-73674785f349 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 25755 microversion: 2.20 time: 0.191071 Jan 15 02:45:09.655854 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 290/604] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:09 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 25755 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 02:45:09.696640 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-8ca41b58-0cd5-4e33-8a0a-2267553157ee tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:09.709491 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8ca41b58-0cd5-4e33-8a0a-2267553157ee tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 7c7210e0-e5b6-4e95-9913-cc36e1f3b666] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:09.723427 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8ca41b58-0cd5-4e33-8a0a-2267553157ee tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:09.725176 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8ca41b58-0cd5-4e33-8a0a-2267553157ee tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:09.727282 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8ca41b58-0cd5-4e33-8a0a-2267553157ee tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:09.728242 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8ca41b58-0cd5-4e33-8a0a-2267553157ee tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:10.049318 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-8ca41b58-0cd5-4e33-8a0a-2267553157ee tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:10.058806 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-8ca41b58-0cd5-4e33-8a0a-2267553157ee tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666" status: 200 len: 1317 microversion: 2.1 time: 0.371257 Jan 15 02:45:10.059413 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 315/605] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:09 2021] GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666 => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:10.270190 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4f0edb06-774a-4fb4-9c66-be50a0712e3f tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:10.271841 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4f0edb06-774a-4fb4-9c66-be50a0712e3f tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] [instance: 333996d9-4a48-440d-bd5f-111d4dddf1a4] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:10.281160 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4f0edb06-774a-4fb4-9c66-be50a0712e3f tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:10.281671 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4f0edb06-774a-4fb4-9c66-be50a0712e3f tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:10.282518 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4f0edb06-774a-4fb4-9c66-be50a0712e3f tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:10.283000 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4f0edb06-774a-4fb4-9c66-be50a0712e3f tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:10.338712 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-4f0edb06-774a-4fb4-9c66-be50a0712e3f tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] HTTP exception thrown: Instance 333996d9-4a48-440d-bd5f-111d4dddf1a4 could not be found. Jan 15 02:45:10.339380 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4f0edb06-774a-4fb4-9c66-be50a0712e3f tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] Returning 404 to user: Instance 333996d9-4a48-440d-bd5f-111d4dddf1a4 could not be found. {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:45:10.340292 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4f0edb06-774a-4fb4-9c66-be50a0712e3f tempest-VolumesSnapshotTestJSON-1850957769 tempest-VolumesSnapshotTestJSON-1850957769] 10.222.0.37 "GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4" status: 404 len: 111 microversion: 2.1 time: 0.080100 Jan 15 02:45:10.340917 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 291/606] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:10 2021] GET /compute/v2.1/servers/333996d9-4a48-440d-bd5f-111d4dddf1a4 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:45:10.670269 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2b14ccf1-17fb-4eed-9945-04dddc4e9eb2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:10.673181 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2b14ccf1-17fb-4eed-9945-04dddc4e9eb2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:10.682057 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2b14ccf1-17fb-4eed-9945-04dddc4e9eb2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:10.691450 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2b14ccf1-17fb-4eed-9945-04dddc4e9eb2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:10.692649 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2b14ccf1-17fb-4eed-9945-04dddc4e9eb2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:10.693306 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2b14ccf1-17fb-4eed-9945-04dddc4e9eb2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:10.868018 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2b14ccf1-17fb-4eed-9945-04dddc4e9eb2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 26707 microversion: 2.20 time: 0.208337 Jan 15 02:45:10.869053 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 316/607] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:10 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 26707 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:11.084782 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-10e10a67-28ae-4062-a3df-e574e113ac6d tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:11.085393 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-10e10a67-28ae-4062-a3df-e574e113ac6d tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 7c7210e0-e5b6-4e95-9913-cc36e1f3b666] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:11.094077 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-10e10a67-28ae-4062-a3df-e574e113ac6d tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:11.094583 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-10e10a67-28ae-4062-a3df-e574e113ac6d tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:11.095430 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-10e10a67-28ae-4062-a3df-e574e113ac6d tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:11.095927 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-10e10a67-28ae-4062-a3df-e574e113ac6d tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:11.901265 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b2c363aa-1934-42c0-8724-9f060a2294cd tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:11.901265 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b2c363aa-1934-42c0-8724-9f060a2294cd tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:11.901265 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b2c363aa-1934-42c0-8724-9f060a2294cd tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:11.902476 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b2c363aa-1934-42c0-8724-9f060a2294cd tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:11.902476 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b2c363aa-1934-42c0-8724-9f060a2294cd tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:11.902952 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b2c363aa-1934-42c0-8724-9f060a2294cd tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:11.907840 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-10e10a67-28ae-4062-a3df-e574e113ac6d tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:11.930750 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-10e10a67-28ae-4062-a3df-e574e113ac6d tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666" status: 200 len: 1317 microversion: 2.1 time: 0.854399 Jan 15 02:45:11.932288 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 292/608] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:11 2021] GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666 => generated 1317 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:12.057565 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b2c363aa-1934-42c0-8724-9f060a2294cd tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 27338 microversion: 2.20 time: 0.180474 Jan 15 02:45:12.059457 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 317/609] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:11 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 27338 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 02:45:12.070270 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-98569119-2ef3-420f-9cc8-053b088ac7aa req-d4f01128-c8c8-43fd-8277-3aa2519f1550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7210e0-e5b6-4e95-9913-cc36e1f3b666", "tag": "e98bb9c6-24e5-46ec-a2f7-579828b21a9a"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:12.077345 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:45:12.077345 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:45:12.087937 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-98569119-2ef3-420f-9cc8-053b088ac7aa req-d4f01128-c8c8-43fd-8277-3aa2519f1550 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:12.088444 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-98569119-2ef3-420f-9cc8-053b088ac7aa req-d4f01128-c8c8-43fd-8277-3aa2519f1550 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:12.107279 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-98569119-2ef3-420f-9cc8-053b088ac7aa req-d4f01128-c8c8-43fd-8277-3aa2519f1550 service nova] Creating event network-changed:e98bb9c6-24e5-46ec-a2f7-579828b21a9a for instance 7c7210e0-e5b6-4e95-9913-cc36e1f3b666 on hv-cinder-76330 Jan 15 02:45:12.112697 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-98569119-2ef3-420f-9cc8-053b088ac7aa req-d4f01128-c8c8-43fd-8277-3aa2519f1550 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177663 Jan 15 02:45:12.113756 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 293/610] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:45:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:45:12.955904 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6717ed09-bcda-47cb-a87a-efc2e5fad940 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:12.956671 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6717ed09-bcda-47cb-a87a-efc2e5fad940 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 7c7210e0-e5b6-4e95-9913-cc36e1f3b666] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:12.965514 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6717ed09-bcda-47cb-a87a-efc2e5fad940 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:12.966056 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6717ed09-bcda-47cb-a87a-efc2e5fad940 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:12.966904 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6717ed09-bcda-47cb-a87a-efc2e5fad940 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:12.967394 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6717ed09-bcda-47cb-a87a-efc2e5fad940 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:13.078206 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c54b1905-dc87-4322-a997-0959bc185f7f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:13.079351 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c54b1905-dc87-4322-a997-0959bc185f7f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:13.088236 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c54b1905-dc87-4322-a997-0959bc185f7f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:13.088751 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c54b1905-dc87-4322-a997-0959bc185f7f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:13.089627 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c54b1905-dc87-4322-a997-0959bc185f7f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:13.090126 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c54b1905-dc87-4322-a997-0959bc185f7f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:13.260907 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6717ed09-bcda-47cb-a87a-efc2e5fad940 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:13.270171 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6717ed09-bcda-47cb-a87a-efc2e5fad940 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666" status: 200 len: 1317 microversion: 2.1 time: 0.323903 Jan 15 02:45:13.270802 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 318/611] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:12 2021] GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666 => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:14.295312 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-aa2a2226-1a8f-44fe-9c9c-58f25d9fa833 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:14.295986 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-aa2a2226-1a8f-44fe-9c9c-58f25d9fa833 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 7c7210e0-e5b6-4e95-9913-cc36e1f3b666] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:14.306307 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-aa2a2226-1a8f-44fe-9c9c-58f25d9fa833 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:14.306815 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-aa2a2226-1a8f-44fe-9c9c-58f25d9fa833 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:14.307660 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-aa2a2226-1a8f-44fe-9c9c-58f25d9fa833 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:14.308209 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-aa2a2226-1a8f-44fe-9c9c-58f25d9fa833 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:14.561200 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-aa2a2226-1a8f-44fe-9c9c-58f25d9fa833 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:14.571524 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-aa2a2226-1a8f-44fe-9c9c-58f25d9fa833 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666" status: 200 len: 1317 microversion: 2.1 time: 0.286572 Jan 15 02:45:14.572143 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 319/612] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:14 2021] GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:45:15.433385 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c54b1905-dc87-4322-a997-0959bc185f7f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 27823 microversion: 2.20 time: 2.365602 Jan 15 02:45:15.438523 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 294/613] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:13 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 27823 bytes in 2369 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 02:45:15.597584 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d656d71c-a7da-4ccc-aeaa-081ff80dfd2c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:15.598313 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d656d71c-a7da-4ccc-aeaa-081ff80dfd2c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 7c7210e0-e5b6-4e95-9913-cc36e1f3b666] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:15.606559 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d656d71c-a7da-4ccc-aeaa-081ff80dfd2c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:15.607066 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d656d71c-a7da-4ccc-aeaa-081ff80dfd2c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:15.607919 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d656d71c-a7da-4ccc-aeaa-081ff80dfd2c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:15.608417 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d656d71c-a7da-4ccc-aeaa-081ff80dfd2c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:16.122556 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d656d71c-a7da-4ccc-aeaa-081ff80dfd2c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:16.132457 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d656d71c-a7da-4ccc-aeaa-081ff80dfd2c tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666" status: 200 len: 1317 microversion: 2.1 time: 0.544450 Jan 15 02:45:16.133117 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 320/614] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:15 2021] GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666 => generated 1317 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:16.454980 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6eed7fde-9b47-4e65-ba17-d567c1de1521 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:16.456505 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6eed7fde-9b47-4e65-ba17-d567c1de1521 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:16.466322 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6eed7fde-9b47-4e65-ba17-d567c1de1521 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:16.466921 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6eed7fde-9b47-4e65-ba17-d567c1de1521 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:16.467661 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6eed7fde-9b47-4e65-ba17-d567c1de1521 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:16.468148 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6eed7fde-9b47-4e65-ba17-d567c1de1521 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:16.628786 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6eed7fde-9b47-4e65-ba17-d567c1de1521 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 28184 microversion: 2.20 time: 0.186329 Jan 15 02:45:16.630226 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 295/615] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:16 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 28184 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:17.163432 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-afd99201-603f-4ada-a55b-5dc049743ddb tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:17.164192 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-afd99201-603f-4ada-a55b-5dc049743ddb tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 7c7210e0-e5b6-4e95-9913-cc36e1f3b666] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:17.174101 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-afd99201-603f-4ada-a55b-5dc049743ddb tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:17.174913 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-afd99201-603f-4ada-a55b-5dc049743ddb tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:17.175780 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-afd99201-603f-4ada-a55b-5dc049743ddb tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:17.176359 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-afd99201-603f-4ada-a55b-5dc049743ddb tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:17.437521 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-afd99201-603f-4ada-a55b-5dc049743ddb tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:17.447580 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-afd99201-603f-4ada-a55b-5dc049743ddb tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666" status: 200 len: 1317 microversion: 2.1 time: 0.295223 Jan 15 02:45:17.448196 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 321/616] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:17 2021] GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666 => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:17.652819 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-dbb78337-6ef3-4a2a-b5fb-047f5730a71f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:17.653924 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-dbb78337-6ef3-4a2a-b5fb-047f5730a71f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:17.663564 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dbb78337-6ef3-4a2a-b5fb-047f5730a71f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:17.664080 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dbb78337-6ef3-4a2a-b5fb-047f5730a71f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:17.664942 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dbb78337-6ef3-4a2a-b5fb-047f5730a71f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:17.665489 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dbb78337-6ef3-4a2a-b5fb-047f5730a71f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:17.829809 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-dbb78337-6ef3-4a2a-b5fb-047f5730a71f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 28184 microversion: 2.20 time: 0.188364 Jan 15 02:45:17.830529 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 296/617] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:17 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 28184 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:18.471777 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a2a201da-2366-41f0-abb8-5ea09c7705b7 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:18.472465 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a2a201da-2366-41f0-abb8-5ea09c7705b7 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 7c7210e0-e5b6-4e95-9913-cc36e1f3b666] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:18.481443 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a2a201da-2366-41f0-abb8-5ea09c7705b7 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:18.481927 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a2a201da-2366-41f0-abb8-5ea09c7705b7 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:18.482758 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a2a201da-2366-41f0-abb8-5ea09c7705b7 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:18.483448 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a2a201da-2366-41f0-abb8-5ea09c7705b7 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:18.753699 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a2a201da-2366-41f0-abb8-5ea09c7705b7 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:18.777778 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a2a201da-2366-41f0-abb8-5ea09c7705b7 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666" status: 200 len: 1317 microversion: 2.1 time: 0.315378 Jan 15 02:45:18.778521 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 322/618] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:18 2021] GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:18.849564 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2db3fb3d-e53e-48df-a5cc-d1f1620311ed tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:18.850778 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2db3fb3d-e53e-48df-a5cc-d1f1620311ed tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:18.859555 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2db3fb3d-e53e-48df-a5cc-d1f1620311ed tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:18.860071 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2db3fb3d-e53e-48df-a5cc-d1f1620311ed tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:18.860935 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2db3fb3d-e53e-48df-a5cc-d1f1620311ed tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:18.861460 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2db3fb3d-e53e-48df-a5cc-d1f1620311ed tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:19.016398 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2db3fb3d-e53e-48df-a5cc-d1f1620311ed tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 28311 microversion: 2.20 time: 0.176833 Jan 15 02:45:19.017556 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 297/619] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:18 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 28311 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:19.026616 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-bc438351-fd17-4527-a2ec-d4943d4df9dc req-d1b9c92d-bd71-4ec7-8478-f74ba03199b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7210e0-e5b6-4e95-9913-cc36e1f3b666", "name": "network-vif-plugged", "status": "completed", "tag": "e98bb9c6-24e5-46ec-a2f7-579828b21a9a"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:19.033949 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:45:19.033949 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:45:19.043771 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-bc438351-fd17-4527-a2ec-d4943d4df9dc req-d1b9c92d-bd71-4ec7-8478-f74ba03199b1 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:19.044280 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-bc438351-fd17-4527-a2ec-d4943d4df9dc req-d1b9c92d-bd71-4ec7-8478-f74ba03199b1 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:19.064089 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-bc438351-fd17-4527-a2ec-d4943d4df9dc req-d1b9c92d-bd71-4ec7-8478-f74ba03199b1 service nova] Creating event network-vif-plugged:e98bb9c6-24e5-46ec-a2f7-579828b21a9a for instance 7c7210e0-e5b6-4e95-9913-cc36e1f3b666 on hv-cinder-76330 Jan 15 02:45:19.070145 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-bc438351-fd17-4527-a2ec-d4943d4df9dc req-d1b9c92d-bd71-4ec7-8478-f74ba03199b1 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145885 Jan 15 02:45:19.071068 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 323/620] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:45:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:45:19.811255 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e5c54554-fd42-49ca-8b9d-ed9e5c42e3b9 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:19.812045 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e5c54554-fd42-49ca-8b9d-ed9e5c42e3b9 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 7c7210e0-e5b6-4e95-9913-cc36e1f3b666] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:19.821754 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e5c54554-fd42-49ca-8b9d-ed9e5c42e3b9 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:19.822278 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e5c54554-fd42-49ca-8b9d-ed9e5c42e3b9 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:19.823136 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e5c54554-fd42-49ca-8b9d-ed9e5c42e3b9 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:19.823631 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e5c54554-fd42-49ca-8b9d-ed9e5c42e3b9 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:20.038532 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-31f08437-3048-4d01-ab04-76e8ccf4de99 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:20.039883 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-31f08437-3048-4d01-ab04-76e8ccf4de99 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:20.050540 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-31f08437-3048-4d01-ab04-76e8ccf4de99 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:20.051782 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-31f08437-3048-4d01-ab04-76e8ccf4de99 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:20.053294 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-31f08437-3048-4d01-ab04-76e8ccf4de99 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:20.054310 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-31f08437-3048-4d01-ab04-76e8ccf4de99 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:20.122206 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e5c54554-fd42-49ca-8b9d-ed9e5c42e3b9 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:20.133334 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e5c54554-fd42-49ca-8b9d-ed9e5c42e3b9 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666" status: 200 len: 1317 microversion: 2.1 time: 0.332583 Jan 15 02:45:20.134222 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 298/621] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:19 2021] GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666 => generated 1317 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:20.232569 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-31f08437-3048-4d01-ab04-76e8ccf4de99 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 28475 microversion: 2.20 time: 0.206408 Jan 15 02:45:20.234535 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 324/622] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:20 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 28475 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:21.157735 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-fb449390-21d6-4cb6-858a-a72bbd20a31a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:21.158329 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-fb449390-21d6-4cb6-858a-a72bbd20a31a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 7c7210e0-e5b6-4e95-9913-cc36e1f3b666] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:21.166937 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fb449390-21d6-4cb6-858a-a72bbd20a31a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:21.167442 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fb449390-21d6-4cb6-858a-a72bbd20a31a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:21.168288 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fb449390-21d6-4cb6-858a-a72bbd20a31a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:21.168782 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fb449390-21d6-4cb6-858a-a72bbd20a31a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:21.262540 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-44114026-e832-435d-895b-95209e3d393c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:21.263949 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-44114026-e832-435d-895b-95209e3d393c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:21.275222 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-44114026-e832-435d-895b-95209e3d393c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:21.275879 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-44114026-e832-435d-895b-95209e3d393c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:21.276868 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-44114026-e832-435d-895b-95209e3d393c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:21.277501 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-44114026-e832-435d-895b-95209e3d393c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:21.443339 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-fb449390-21d6-4cb6-858a-a72bbd20a31a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:21.448079 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-44114026-e832-435d-895b-95209e3d393c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 28642 microversion: 2.20 time: 0.204096 Jan 15 02:45:21.449122 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 325/623] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:21 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 28642 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:21.453519 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-fb449390-21d6-4cb6-858a-a72bbd20a31a tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666" status: 200 len: 1508 microversion: 2.1 time: 0.305315 Jan 15 02:45:21.454179 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 299/624] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:21 2021] GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666 => generated 1508 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:22.467589 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4b03a455-ceae-409a-83c2-a60080a9ce04 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:22.468732 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4b03a455-ceae-409a-83c2-a60080a9ce04 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:22.478560 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4b03a455-ceae-409a-83c2-a60080a9ce04 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:22.479109 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4b03a455-ceae-409a-83c2-a60080a9ce04 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:22.479919 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4b03a455-ceae-409a-83c2-a60080a9ce04 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:22.480413 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4b03a455-ceae-409a-83c2-a60080a9ce04 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:25.133540 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4b03a455-ceae-409a-83c2-a60080a9ce04 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 28642 microversion: 2.20 time: 2.676458 Jan 15 02:45:25.137968 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 326/625] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:22 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 28642 bytes in 2679 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:26.152638 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-01384301-0020-4015-81a2-8bc9dd496f0f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:26.153625 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-01384301-0020-4015-81a2-8bc9dd496f0f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:26.161985 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-01384301-0020-4015-81a2-8bc9dd496f0f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:26.162494 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-01384301-0020-4015-81a2-8bc9dd496f0f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:26.163324 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-01384301-0020-4015-81a2-8bc9dd496f0f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:26.163808 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-01384301-0020-4015-81a2-8bc9dd496f0f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:26.306637 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-01384301-0020-4015-81a2-8bc9dd496f0f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 28642 microversion: 2.20 time: 0.164129 Jan 15 02:45:26.310868 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 300/626] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:26 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 28642 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:26.438728 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-01d56dab-14ed-465a-925c-93bbc3debb73 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b882811-3ae1-4f65-a505-7e133887e6bd"}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:26.440040 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-01d56dab-14ed-465a-925c-93bbc3debb73 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 7c7210e0-e5b6-4e95-9913-cc36e1f3b666] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:26.449887 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-01d56dab-14ed-465a-925c-93bbc3debb73 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:26.450381 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-01d56dab-14ed-465a-925c-93bbc3debb73 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:26.451461 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-01d56dab-14ed-465a-925c-93bbc3debb73 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:26.451961 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-01d56dab-14ed-465a-925c-93bbc3debb73 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:26.902038 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-01d56dab-14ed-465a-925c-93bbc3debb73 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "POST /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.473503 Jan 15 02:45:26.902816 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 327/627] 10.222.0.37 () {60 vars in 1313 bytes} [Fri Jan 15 02:45:26 2021] POST /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666/os-volume_attachments => generated 194 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:45:27.325948 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ec99f81c-f7f6-4336-9b5f-e0605302ab2f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:27.327107 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ec99f81c-f7f6-4336-9b5f-e0605302ab2f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:27.336846 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ec99f81c-f7f6-4336-9b5f-e0605302ab2f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:27.337383 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ec99f81c-f7f6-4336-9b5f-e0605302ab2f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:27.338244 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ec99f81c-f7f6-4336-9b5f-e0605302ab2f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:27.338731 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ec99f81c-f7f6-4336-9b5f-e0605302ab2f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:27.481194 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ec99f81c-f7f6-4336-9b5f-e0605302ab2f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 28642 microversion: 2.20 time: 0.165503 Jan 15 02:45:27.481908 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 301/628] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:27 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 28642 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:28.501063 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-fa454ae7-580b-4c9c-87c9-b5e7c55d35e1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:28.502190 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-fa454ae7-580b-4c9c-87c9-b5e7c55d35e1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:28.511976 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fa454ae7-580b-4c9c-87c9-b5e7c55d35e1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:28.512415 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fa454ae7-580b-4c9c-87c9-b5e7c55d35e1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:28.513311 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fa454ae7-580b-4c9c-87c9-b5e7c55d35e1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:28.513804 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fa454ae7-580b-4c9c-87c9-b5e7c55d35e1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:28.663919 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-fa454ae7-580b-4c9c-87c9-b5e7c55d35e1 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 28642 microversion: 2.20 time: 0.172925 Jan 15 02:45:28.668349 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 328/629] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:28 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 28642 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 02:45:29.683737 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9d519ee8-8b17-4040-88cb-77b824e6118f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:29.684868 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9d519ee8-8b17-4040-88cb-77b824e6118f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:29.693619 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9d519ee8-8b17-4040-88cb-77b824e6118f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:29.694188 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9d519ee8-8b17-4040-88cb-77b824e6118f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:29.695039 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9d519ee8-8b17-4040-88cb-77b824e6118f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:29.695531 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9d519ee8-8b17-4040-88cb-77b824e6118f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:29.842503 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9d519ee8-8b17-4040-88cb-77b824e6118f tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 30083 microversion: 2.20 time: 0.169356 Jan 15 02:45:29.843241 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 302/630] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:29 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 30083 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:30.861751 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3ec74887-5210-4374-938f-23f7c4cea04d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:30.862824 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3ec74887-5210-4374-938f-23f7c4cea04d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:30.872941 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3ec74887-5210-4374-938f-23f7c4cea04d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:30.873480 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3ec74887-5210-4374-938f-23f7c4cea04d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:30.874334 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3ec74887-5210-4374-938f-23f7c4cea04d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:30.877890 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3ec74887-5210-4374-938f-23f7c4cea04d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:31.035529 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3ec74887-5210-4374-938f-23f7c4cea04d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 31824 microversion: 2.20 time: 0.183565 Jan 15 02:45:31.036263 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 329/631] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:30 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 31824 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:32.059618 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-0cd4b7f0-8aaf-4061-a5ad-b88733df2b38 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:32.060765 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-0cd4b7f0-8aaf-4061-a5ad-b88733df2b38 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:32.070148 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0cd4b7f0-8aaf-4061-a5ad-b88733df2b38 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:32.070659 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0cd4b7f0-8aaf-4061-a5ad-b88733df2b38 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:32.071519 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0cd4b7f0-8aaf-4061-a5ad-b88733df2b38 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:32.072001 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0cd4b7f0-8aaf-4061-a5ad-b88733df2b38 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:32.226513 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-0cd4b7f0-8aaf-4061-a5ad-b88733df2b38 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 32830 microversion: 2.20 time: 0.180791 Jan 15 02:45:32.227157 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 303/632] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:32 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 32830 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:32.559827 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-41cc457b-4d3b-4119-ac74-4d4078479d60 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:32.560475 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-41cc457b-4d3b-4119-ac74-4d4078479d60 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:32.570662 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-41cc457b-4d3b-4119-ac74-4d4078479d60 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:32.571189 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-41cc457b-4d3b-4119-ac74-4d4078479d60 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:32.572050 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-41cc457b-4d3b-4119-ac74-4d4078479d60 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:32.572534 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-41cc457b-4d3b-4119-ac74-4d4078479d60 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:32.647791 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-41cc457b-4d3b-4119-ac74-4d4078479d60 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Going to try to terminate instance {{(pid=94111) delete /opt/stack/nova/nova/compute/api.py:2535}} Jan 15 02:45:32.769942 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-41cc457b-4d3b-4119-ac74-4d4078479d60 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "DELETE /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 204 len: 0 microversion: 2.1 time: 0.220012 Jan 15 02:45:32.770925 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 330/633] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:45:32 2021] DELETE /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 02:45:32.786714 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2b9c76f7-b142-424c-b1a6-5c008cedfbe2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:32.787488 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2b9c76f7-b142-424c-b1a6-5c008cedfbe2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:32.796102 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2b9c76f7-b142-424c-b1a6-5c008cedfbe2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:32.796607 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2b9c76f7-b142-424c-b1a6-5c008cedfbe2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:32.797471 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2b9c76f7-b142-424c-b1a6-5c008cedfbe2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:32.797958 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2b9c76f7-b142-424c-b1a6-5c008cedfbe2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:33.044338 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-2b9c76f7-b142-424c-b1a6-5c008cedfbe2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:33.054642 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2b9c76f7-b142-424c-b1a6-5c008cedfbe2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1675 microversion: 2.1 time: 0.278491 Jan 15 02:45:33.055283 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 304/634] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:32 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1675 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:33.245927 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f63a1bc0-cc64-44f0-8624-30aea5ac8342 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:33.247083 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f63a1bc0-cc64-44f0-8624-30aea5ac8342 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:33.255259 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f63a1bc0-cc64-44f0-8624-30aea5ac8342 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:33.255774 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f63a1bc0-cc64-44f0-8624-30aea5ac8342 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:33.256626 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f63a1bc0-cc64-44f0-8624-30aea5ac8342 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:33.257149 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f63a1bc0-cc64-44f0-8624-30aea5ac8342 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:33.421953 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f63a1bc0-cc64-44f0-8624-30aea5ac8342 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 33430 microversion: 2.20 time: 0.186172 Jan 15 02:45:33.422674 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 331/635] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:33 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 33430 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:34.079151 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-89ea38a1-6f13-40a6-95da-a4ea345467a8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:34.079736 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-89ea38a1-6f13-40a6-95da-a4ea345467a8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:34.088481 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-89ea38a1-6f13-40a6-95da-a4ea345467a8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:34.088986 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-89ea38a1-6f13-40a6-95da-a4ea345467a8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:34.089887 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-89ea38a1-6f13-40a6-95da-a4ea345467a8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:34.090381 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-89ea38a1-6f13-40a6-95da-a4ea345467a8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:34.348675 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-89ea38a1-6f13-40a6-95da-a4ea345467a8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:34.358038 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-89ea38a1-6f13-40a6-95da-a4ea345467a8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1675 microversion: 2.1 time: 0.288043 Jan 15 02:45:34.358473 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 305/636] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:34 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1675 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:34.443001 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-702815b7-5f6c-449f-a731-be70a5a8e4c0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:34.444209 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-702815b7-5f6c-449f-a731-be70a5a8e4c0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:34.452983 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-702815b7-5f6c-449f-a731-be70a5a8e4c0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:34.453525 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-702815b7-5f6c-449f-a731-be70a5a8e4c0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:34.454373 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-702815b7-5f6c-449f-a731-be70a5a8e4c0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:34.454868 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-702815b7-5f6c-449f-a731-be70a5a8e4c0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:34.612212 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-702815b7-5f6c-449f-a731-be70a5a8e4c0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 33922 microversion: 2.20 time: 0.181841 Jan 15 02:45:34.613022 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 332/637] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:34 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 33922 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:34.982220 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ecda417e-8921-4232-8406-c6769a6c9e61 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:34.982762 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ecda417e-8921-4232-8406-c6769a6c9e61 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 7c7210e0-e5b6-4e95-9913-cc36e1f3b666] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:34.990750 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ecda417e-8921-4232-8406-c6769a6c9e61 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:34.991252 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ecda417e-8921-4232-8406-c6769a6c9e61 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:34.992075 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ecda417e-8921-4232-8406-c6769a6c9e61 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:34.992562 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ecda417e-8921-4232-8406-c6769a6c9e61 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:35.271087 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ecda417e-8921-4232-8406-c6769a6c9e61 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "DELETE /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666/os-volume_attachments/3b882811-3ae1-4f65-a505-7e133887e6bd" status: 202 len: 0 microversion: 2.1 time: 0.298177 Jan 15 02:45:35.271750 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 306/638] 10.222.0.37 () {58 vars in 1406 bytes} [Fri Jan 15 02:45:34 2021] DELETE /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666/os-volume_attachments/3b882811-3ae1-4f65-a505-7e133887e6bd => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:35.383303 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d0dab974-4af0-42bf-be9f-d7c70a543cca tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:35.383976 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d0dab974-4af0-42bf-be9f-d7c70a543cca tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:35.393114 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d0dab974-4af0-42bf-be9f-d7c70a543cca tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:35.393635 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d0dab974-4af0-42bf-be9f-d7c70a543cca tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:35.394506 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d0dab974-4af0-42bf-be9f-d7c70a543cca tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:35.394999 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d0dab974-4af0-42bf-be9f-d7c70a543cca tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:35.631430 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-392a5b8b-2814-45ef-92c8-3e33cc4db96d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:35.632929 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-392a5b8b-2814-45ef-92c8-3e33cc4db96d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:35.644076 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d0dab974-4af0-42bf-be9f-d7c70a543cca tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:35.644257 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-392a5b8b-2814-45ef-92c8-3e33cc4db96d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:35.644778 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-392a5b8b-2814-45ef-92c8-3e33cc4db96d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:35.645825 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-392a5b8b-2814-45ef-92c8-3e33cc4db96d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:35.646340 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-392a5b8b-2814-45ef-92c8-3e33cc4db96d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:35.654114 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d0dab974-4af0-42bf-be9f-d7c70a543cca tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1675 microversion: 2.1 time: 0.281550 Jan 15 02:45:35.654911 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 333/639] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:35 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1675 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:45:35.870508 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-392a5b8b-2814-45ef-92c8-3e33cc4db96d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 34962 microversion: 2.20 time: 0.249917 Jan 15 02:45:35.871677 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 307/640] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:35 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 34962 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 02:45:36.042053 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-e4fbc4dc-c76d-458d-8128-c0363586f608 req-63d89237-54a9-4c83-9b9b-989a76db42ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e38a45f-624e-4ca4-9f81-3d92ce319b50", "name": "network-vif-unplugged", "status": "completed", "tag": "cb869005-2805-494c-8e3f-55bd108b2f03"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:36.049587 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:45:36.049587 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:45:36.060604 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-e4fbc4dc-c76d-458d-8128-c0363586f608 req-63d89237-54a9-4c83-9b9b-989a76db42ab service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:36.061256 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-e4fbc4dc-c76d-458d-8128-c0363586f608 req-63d89237-54a9-4c83-9b9b-989a76db42ab service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:36.079812 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-e4fbc4dc-c76d-458d-8128-c0363586f608 req-63d89237-54a9-4c83-9b9b-989a76db42ab service nova] Creating event network-vif-unplugged:cb869005-2805-494c-8e3f-55bd108b2f03 for instance 6e38a45f-624e-4ca4-9f81-3d92ce319b50 on hv-cinder-76330 Jan 15 02:45:36.085780 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-e4fbc4dc-c76d-458d-8128-c0363586f608 req-63d89237-54a9-4c83-9b9b-989a76db42ab service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054569 Jan 15 02:45:36.086711 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 334/641] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:45:36 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:45:36.690472 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c5fa8a9f-7c0b-4f8b-ba1e-768465f296d8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:36.691732 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c5fa8a9f-7c0b-4f8b-ba1e-768465f296d8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:36.700172 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c5fa8a9f-7c0b-4f8b-ba1e-768465f296d8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:36.700674 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c5fa8a9f-7c0b-4f8b-ba1e-768465f296d8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:36.701546 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c5fa8a9f-7c0b-4f8b-ba1e-768465f296d8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:36.702263 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c5fa8a9f-7c0b-4f8b-ba1e-768465f296d8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:36.855797 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c5fa8a9f-7c0b-4f8b-ba1e-768465f296d8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:36.868627 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c5fa8a9f-7c0b-4f8b-ba1e-768465f296d8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1607 microversion: 2.1 time: 0.198732 Jan 15 02:45:36.869741 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 308/642] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:36 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1607 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:36.893182 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-0a25fec3-24ec-47d5-886f-c40a23fce97c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:36.895205 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-0a25fec3-24ec-47d5-886f-c40a23fce97c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:36.904202 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0a25fec3-24ec-47d5-886f-c40a23fce97c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:36.904811 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0a25fec3-24ec-47d5-886f-c40a23fce97c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:36.905784 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0a25fec3-24ec-47d5-886f-c40a23fce97c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:36.906355 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0a25fec3-24ec-47d5-886f-c40a23fce97c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:37.063962 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-0a25fec3-24ec-47d5-886f-c40a23fce97c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 35788 microversion: 2.20 time: 0.182020 Jan 15 02:45:37.069563 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 335/643] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:36 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 35788 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:37.517758 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-b5607a97-5a60-4142-97ee-69976bef3ada req-dd9af18e-839a-4269-b58f-fff2a4776890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e38a45f-624e-4ca4-9f81-3d92ce319b50", "name": "network-vif-deleted", "tag": "cb869005-2805-494c-8e3f-55bd108b2f03"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:37.528452 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:45:37.528452 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:45:37.537942 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-b5607a97-5a60-4142-97ee-69976bef3ada req-dd9af18e-839a-4269-b58f-fff2a4776890 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:37.538453 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-b5607a97-5a60-4142-97ee-69976bef3ada req-dd9af18e-839a-4269-b58f-fff2a4776890 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:37.558999 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-b5607a97-5a60-4142-97ee-69976bef3ada req-dd9af18e-839a-4269-b58f-fff2a4776890 service nova] Creating event network-vif-deleted:cb869005-2805-494c-8e3f-55bd108b2f03 for instance 6e38a45f-624e-4ca4-9f81-3d92ce319b50 on hv-cinder-76330 Jan 15 02:45:37.564391 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-b5607a97-5a60-4142-97ee-69976bef3ada req-dd9af18e-839a-4269-b58f-fff2a4776890 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055896 Jan 15 02:45:37.565269 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 309/644] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:45:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:45:37.898942 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b17c03cb-ca84-491a-860d-4291b9a94564 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:37.899729 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b17c03cb-ca84-491a-860d-4291b9a94564 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:37.909198 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b17c03cb-ca84-491a-860d-4291b9a94564 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:37.909718 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b17c03cb-ca84-491a-860d-4291b9a94564 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:37.910974 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b17c03cb-ca84-491a-860d-4291b9a94564 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:37.911667 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b17c03cb-ca84-491a-860d-4291b9a94564 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:37.999706 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b17c03cb-ca84-491a-860d-4291b9a94564 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:38.000319 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b17c03cb-ca84-491a-860d-4291b9a94564 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:38.000683 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.objects.instance [None req-b17c03cb-ca84-491a-860d-4291b9a94564 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lazy-loading 'fault' on Instance uuid 6e38a45f-624e-4ca4-9f81-3d92ce319b50 {{(pid=94111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Jan 15 02:45:38.085281 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-cd258732-1374-4e20-8007-2f63e2a7d555 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:38.086454 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-cd258732-1374-4e20-8007-2f63e2a7d555 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:38.094885 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cd258732-1374-4e20-8007-2f63e2a7d555 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:38.095412 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cd258732-1374-4e20-8007-2f63e2a7d555 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:38.096269 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cd258732-1374-4e20-8007-2f63e2a7d555 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:38.096763 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cd258732-1374-4e20-8007-2f63e2a7d555 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:38.115379 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b17c03cb-ca84-491a-860d-4291b9a94564 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:38.126540 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b17c03cb-ca84-491a-860d-4291b9a94564 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 200 len: 1327 microversion: 2.1 time: 0.241523 Jan 15 02:45:38.127426 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 336/645] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:37 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 1327 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:38.289700 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-cd258732-1374-4e20-8007-2f63e2a7d555 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 36909 microversion: 2.20 time: 0.215323 Jan 15 02:45:38.290691 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 310/646] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:38 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 36909 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:38.951167 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9f01a365-5693-4656-9939-0743d06afcae tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:38.951747 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9f01a365-5693-4656-9939-0743d06afcae tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 7c7210e0-e5b6-4e95-9913-cc36e1f3b666] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:38.961209 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9f01a365-5693-4656-9939-0743d06afcae tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:38.961717 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9f01a365-5693-4656-9939-0743d06afcae tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:38.962554 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9f01a365-5693-4656-9939-0743d06afcae tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:38.963045 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9f01a365-5693-4656-9939-0743d06afcae tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:39.037248 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9f01a365-5693-4656-9939-0743d06afcae tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 7c7210e0-e5b6-4e95-9913-cc36e1f3b666] Going to try to terminate instance {{(pid=94111) delete /opt/stack/nova/nova/compute/api.py:2535}} Jan 15 02:45:39.153896 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-38d8cc51-2cf7-4992-b436-f7ca6936bb9e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:39.155001 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-38d8cc51-2cf7-4992-b436-f7ca6936bb9e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:39.161802 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9f01a365-5693-4656-9939-0743d06afcae tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "DELETE /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666" status: 204 len: 0 microversion: 2.1 time: 0.218203 Jan 15 02:45:39.161912 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 337/647] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:45:38 2021] DELETE /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 02:45:39.169894 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-38d8cc51-2cf7-4992-b436-f7ca6936bb9e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:39.170504 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-38d8cc51-2cf7-4992-b436-f7ca6936bb9e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:39.171453 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-38d8cc51-2cf7-4992-b436-f7ca6936bb9e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:39.172040 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-38d8cc51-2cf7-4992-b436-f7ca6936bb9e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:39.180808 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-14935044-57ab-45c2-a601-2d67b334e028 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:39.181766 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-14935044-57ab-45c2-a601-2d67b334e028 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 7c7210e0-e5b6-4e95-9913-cc36e1f3b666] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:39.189810 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-14935044-57ab-45c2-a601-2d67b334e028 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:39.190420 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-14935044-57ab-45c2-a601-2d67b334e028 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:39.191473 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-14935044-57ab-45c2-a601-2d67b334e028 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:39.192275 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-14935044-57ab-45c2-a601-2d67b334e028 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:39.231665 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-38d8cc51-2cf7-4992-b436-f7ca6936bb9e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] HTTP exception thrown: Instance 6e38a45f-624e-4ca4-9f81-3d92ce319b50 could not be found. Jan 15 02:45:39.232454 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-38d8cc51-2cf7-4992-b436-f7ca6936bb9e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Returning 404 to user: Instance 6e38a45f-624e-4ca4-9f81-3d92ce319b50 could not be found. {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:45:39.233517 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-38d8cc51-2cf7-4992-b436-f7ca6936bb9e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 404 len: 111 microversion: 2.1 time: 0.091142 Jan 15 02:45:39.238035 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 311/648] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:39 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:45:39.248971 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a9397bd9-415d-4baa-94f8-4d9862acace8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '.version_select at 0x7f878f0722f0>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:39.279090 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a9397bd9-415d-4baa-94f8-4d9862acace8 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-826258009" status: 202 len: 0 microversion: 2.1 time: 0.038858 Jan 15 02:45:39.280051 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 312/649] 10.222.0.37 () {58 vars in 1208 bytes} [Fri Jan 15 02:45:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-826258009 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:39.308146 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9881e72f-416c-4b08-a98c-cc2ff67996c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:39.309375 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9881e72f-416c-4b08-a98c-cc2ff67996c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:39.318986 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9881e72f-416c-4b08-a98c-cc2ff67996c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:39.319586 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9881e72f-416c-4b08-a98c-cc2ff67996c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:39.320728 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9881e72f-416c-4b08-a98c-cc2ff67996c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:39.321218 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9881e72f-416c-4b08-a98c-cc2ff67996c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:39.481998 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9881e72f-416c-4b08-a98c-cc2ff67996c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 37978 microversion: 2.20 time: 0.183708 Jan 15 02:45:39.483375 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 313/650] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:39 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 37978 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 02:45:39.697389 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-14935044-57ab-45c2-a601-2d67b334e028 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:39.712210 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-14935044-57ab-45c2-a601-2d67b334e028 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666" status: 200 len: 1514 microversion: 2.1 time: 0.541665 Jan 15 02:45:39.712857 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 338/651] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:39 2021] GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666 => generated 1514 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:40.500807 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6462628d-8b75-469e-ba76-f82cf50d8c67 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:40.502066 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6462628d-8b75-469e-ba76-f82cf50d8c67 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:40.511361 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6462628d-8b75-469e-ba76-f82cf50d8c67 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:40.511878 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6462628d-8b75-469e-ba76-f82cf50d8c67 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:40.512743 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6462628d-8b75-469e-ba76-f82cf50d8c67 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:40.513271 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6462628d-8b75-469e-ba76-f82cf50d8c67 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:40.679816 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6462628d-8b75-469e-ba76-f82cf50d8c67 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 38191 microversion: 2.20 time: 0.188660 Jan 15 02:45:40.680631 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 314/652] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:40 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 38191 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:40.738059 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a9969c1f-903a-4af5-8013-8754321d9cdd tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:40.738752 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a9969c1f-903a-4af5-8013-8754321d9cdd tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 7c7210e0-e5b6-4e95-9913-cc36e1f3b666] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:40.747347 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a9969c1f-903a-4af5-8013-8754321d9cdd tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:40.747860 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a9969c1f-903a-4af5-8013-8754321d9cdd tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:40.748719 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a9969c1f-903a-4af5-8013-8754321d9cdd tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:40.749288 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a9969c1f-903a-4af5-8013-8754321d9cdd tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:40.997236 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ff3b0dee-f004-4e99-a775-b1c1c2420c9c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'create', calling method: .version_select at 0x7f878e625158>, body: {"keypair": {"name": "tempest-keypair-319502259"}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:41.032578 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-ff3b0dee-f004-4e99-a775-b1c1c2420c9c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Getting quotas for project 9ae05708286f4222bc7584d7b1dea622. Resources: {'key_pairs'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:45:41.037132 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-ff3b0dee-f004-4e99-a775-b1c1c2420c9c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Getting quotas for user 89505fd3686440cc939ec8fbe725ee90 and project 9ae05708286f4222bc7584d7b1dea622. Resources: {'key_pairs'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:45:41.048733 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a9969c1f-903a-4af5-8013-8754321d9cdd tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:41.057973 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a9969c1f-903a-4af5-8013-8754321d9cdd tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666" status: 200 len: 1514 microversion: 2.1 time: 0.329640 Jan 15 02:45:41.058580 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 339/653] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:40 2021] GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666 => generated 1514 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:41.194881 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-ff3b0dee-f004-4e99-a775-b1c1c2420c9c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Getting quotas for project 9ae05708286f4222bc7584d7b1dea622. Resources: {'key_pairs'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:45:41.198840 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-ff3b0dee-f004-4e99-a775-b1c1c2420c9c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Getting quotas for user 89505fd3686440cc939ec8fbe725ee90 and project 9ae05708286f4222bc7584d7b1dea622. Resources: {'key_pairs'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:45:41.213106 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ff3b0dee-f004-4e99-a775-b1c1c2420c9c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.225940 Jan 15 02:45:41.213776 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 315/654] 10.222.0.37 () {60 vars in 1148 bytes} [Fri Jan 15 02:45:40 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:45:41.697784 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-045da844-fc79-4c38-aa88-b1912f2238f2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:41.698871 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-045da844-fc79-4c38-aa88-b1912f2238f2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:41.707352 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-045da844-fc79-4c38-aa88-b1912f2238f2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:41.707866 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-045da844-fc79-4c38-aa88-b1912f2238f2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:41.708737 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-045da844-fc79-4c38-aa88-b1912f2238f2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:41.709266 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-045da844-fc79-4c38-aa88-b1912f2238f2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:41.843741 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-045da844-fc79-4c38-aa88-b1912f2238f2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 38191 microversion: 2.20 time: 0.155087 Jan 15 02:45:41.849236 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 340/655] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:41 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 38191 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:42.086854 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6e6bad18-031b-4527-b245-de632662bf67 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:42.088050 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6e6bad18-031b-4527-b245-de632662bf67 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 7c7210e0-e5b6-4e95-9913-cc36e1f3b666] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:42.099265 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6e6bad18-031b-4527-b245-de632662bf67 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:42.100091 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6e6bad18-031b-4527-b245-de632662bf67 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:42.101395 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6e6bad18-031b-4527-b245-de632662bf67 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:42.102085 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6e6bad18-031b-4527-b245-de632662bf67 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:42.160321 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-5505efd4-21c9-4b0f-98cf-443f88e79f92 req-c495645c-ad8e-433d-a7e9-53caee68280b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7210e0-e5b6-4e95-9913-cc36e1f3b666", "name": "network-vif-unplugged", "status": "completed", "tag": "e98bb9c6-24e5-46ec-a2f7-579828b21a9a"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:42.183983 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:45:42.183983 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:45:42.202148 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-5505efd4-21c9-4b0f-98cf-443f88e79f92 req-c495645c-ad8e-433d-a7e9-53caee68280b service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:42.202813 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-5505efd4-21c9-4b0f-98cf-443f88e79f92 req-c495645c-ad8e-433d-a7e9-53caee68280b service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:42.239083 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-5505efd4-21c9-4b0f-98cf-443f88e79f92 req-c495645c-ad8e-433d-a7e9-53caee68280b service nova] Creating event network-vif-unplugged:e98bb9c6-24e5-46ec-a2f7-579828b21a9a for instance 7c7210e0-e5b6-4e95-9913-cc36e1f3b666 on hv-cinder-76330 Jan 15 02:45:42.244691 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-5505efd4-21c9-4b0f-98cf-443f88e79f92 req-c495645c-ad8e-433d-a7e9-53caee68280b service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105691 Jan 15 02:45:42.245529 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 341/656] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:45:42 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:45:42.463651 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6e6bad18-031b-4527-b245-de632662bf67 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:42.472688 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6e6bad18-031b-4527-b245-de632662bf67 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666" status: 200 len: 1514 microversion: 2.1 time: 0.398351 Jan 15 02:45:42.473364 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 316/657] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:42 2021] GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666 => generated 1514 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:42.864624 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-84e26f7d-bd0c-4004-be77-28a8091bd16c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:42.865816 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-84e26f7d-bd0c-4004-be77-28a8091bd16c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:42.874472 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-84e26f7d-bd0c-4004-be77-28a8091bd16c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:42.874988 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-84e26f7d-bd0c-4004-be77-28a8091bd16c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:42.875858 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-84e26f7d-bd0c-4004-be77-28a8091bd16c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:42.876349 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-84e26f7d-bd0c-4004-be77-28a8091bd16c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:43.021330 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-84e26f7d-bd0c-4004-be77-28a8091bd16c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 200 len: 38333 microversion: 2.20 time: 0.167363 Jan 15 02:45:43.027463 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 342/658] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:42 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 38333 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:43.038505 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-253c5a90-73b7-4073-b6d4-fcadb0a9d238 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:43.039349 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-253c5a90-73b7-4073-b6d4-fcadb0a9d238 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:43.047095 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-253c5a90-73b7-4073-b6d4-fcadb0a9d238 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:43.047607 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-253c5a90-73b7-4073-b6d4-fcadb0a9d238 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:43.048454 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-253c5a90-73b7-4073-b6d4-fcadb0a9d238 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:43.048956 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-253c5a90-73b7-4073-b6d4-fcadb0a9d238 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:43.119659 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-253c5a90-73b7-4073-b6d4-fcadb0a9d238 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/ips" status: 200 len: 153 microversion: 2.20 time: 0.090589 Jan 15 02:45:43.120602 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 317/659] 10.222.0.37 () {60 vars in 1279 bytes} [Fri Jan 15 02:45:43 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/ips => generated 153 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:45:43.498896 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-270b5ac5-4560-4488-a1b4-4dcb9f2075ac tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:43.499685 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-270b5ac5-4560-4488-a1b4-4dcb9f2075ac tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 7c7210e0-e5b6-4e95-9913-cc36e1f3b666] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:43.510095 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-270b5ac5-4560-4488-a1b4-4dcb9f2075ac tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:43.510611 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-270b5ac5-4560-4488-a1b4-4dcb9f2075ac tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:43.511474 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-270b5ac5-4560-4488-a1b4-4dcb9f2075ac tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:43.511972 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-270b5ac5-4560-4488-a1b4-4dcb9f2075ac tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:43.754917 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1bd3aa89-5ed4-4bdd-8495-464e40825afe tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-801793953", "imageRef": "1807a1cb-835d-4a56-8751-82ffa40b12c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f773a4fc-cf3f-4ca8-a066-31288f50d5f7"}], "security_groups": [{"name": "tempest-securitygroup--1942109897"}], "key_name": "tempest-keypair-319502259", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:43.849809 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-270b5ac5-4560-4488-a1b4-4dcb9f2075ac tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:43.859492 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-270b5ac5-4560-4488-a1b4-4dcb9f2075ac tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666" status: 200 len: 1472 microversion: 2.1 time: 0.371469 Jan 15 02:45:43.860105 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 343/660] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:43 2021] GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666 => generated 1472 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:43.911955 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-2696550d-7fa7-4fc2-9caf-db85684f0b1b req-285c003b-9778-4c6a-a4c5-43f8c108dba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7210e0-e5b6-4e95-9913-cc36e1f3b666", "name": "network-vif-deleted", "tag": "e98bb9c6-24e5-46ec-a2f7-579828b21a9a"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:43.918855 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:45:43.918855 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:45:43.928386 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-2696550d-7fa7-4fc2-9caf-db85684f0b1b req-285c003b-9778-4c6a-a4c5-43f8c108dba2 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:43.934731 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-2696550d-7fa7-4fc2-9caf-db85684f0b1b req-285c003b-9778-4c6a-a4c5-43f8c108dba2 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:43.941446 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-1bd3aa89-5ed4-4bdd-8495-464e40825afe tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] validate_networks() for [('f773a4fc-cf3f-4ca8-a066-31288f50d5f7', None, None, None)] {{(pid=94112) validate_networks /opt/stack/nova/nova/network/neutron.py:2340}} Jan 15 02:45:43.963730 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-2696550d-7fa7-4fc2-9caf-db85684f0b1b req-285c003b-9778-4c6a-a4c5-43f8c108dba2 service nova] Creating event network-vif-deleted:e98bb9c6-24e5-46ec-a2f7-579828b21a9a for instance 7c7210e0-e5b6-4e95-9913-cc36e1f3b666 on hv-cinder-76330 Jan 15 02:45:43.970253 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-2696550d-7fa7-4fc2-9caf-db85684f0b1b req-285c003b-9778-4c6a-a4c5-43f8c108dba2 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067825 Jan 15 02:45:43.970911 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 344/661] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:45:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:45:44.743735 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-1bd3aa89-5ed4-4bdd-8495-464e40825afe tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Flavor limits 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 02:45:44.744201 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-1bd3aa89-5ed4-4bdd-8495-464e40825afe tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Image limits 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Jan 15 02:45:44.744734 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-1bd3aa89-5ed4-4bdd-8495-464e40825afe tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Flavor pref 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 02:45:44.745234 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-1bd3aa89-5ed4-4bdd-8495-464e40825afe tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Image pref 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Jan 15 02:45:44.745685 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-1bd3aa89-5ed4-4bdd-8495-464e40825afe tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Jan 15 02:45:44.755536 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1bd3aa89-5ed4-4bdd-8495-464e40825afe tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:44.756040 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1bd3aa89-5ed4-4bdd-8495-464e40825afe tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:44.756909 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1bd3aa89-5ed4-4bdd-8495-464e40825afe tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:44.757437 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1bd3aa89-5ed4-4bdd-8495-464e40825afe tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:44.778708 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-1bd3aa89-5ed4-4bdd-8495-464e40825afe tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Getting quotas for project 9ae05708286f4222bc7584d7b1dea622. Resources: {'ram', 'instances', 'cores'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:45:44.783507 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-1bd3aa89-5ed4-4bdd-8495-464e40825afe tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Getting quotas for user 89505fd3686440cc939ec8fbe725ee90 and project 9ae05708286f4222bc7584d7b1dea622. Resources: {'ram', 'instances', 'cores'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:45:44.796738 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1bd3aa89-5ed4-4bdd-8495-464e40825afe tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Going to run 1 instances... {{(pid=94112) _provision_instances /opt/stack/nova/nova/compute/api.py:1263}} Jan 15 02:45:44.799332 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1bd3aa89-5ed4-4bdd-8495-464e40825afe tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1807a1cb-835d-4a56-8751-82ffa40b12c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94112) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1661}} Jan 15 02:45:44.852784 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1bd3aa89-5ed4-4bdd-8495-464e40825afe tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.108144 Jan 15 02:45:44.854124 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 318/662] 10.222.0.37 () {60 vars in 1137 bytes} [Fri Jan 15 02:45:43 2021] POST /compute/v2.1/servers => generated 402 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 02:45:44.871963 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2e0f1f9f-3a14-4507-b2cd-d951649473c6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:44.873159 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2e0f1f9f-3a14-4507-b2cd-d951649473c6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:44.887112 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-cf143bb5-2594-4017-8ccc-16723c5d2db3 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:44.887672 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-cf143bb5-2594-4017-8ccc-16723c5d2db3 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 7c7210e0-e5b6-4e95-9913-cc36e1f3b666] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:44.898331 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cf143bb5-2594-4017-8ccc-16723c5d2db3 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:44.898841 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cf143bb5-2594-4017-8ccc-16723c5d2db3 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:44.899698 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cf143bb5-2594-4017-8ccc-16723c5d2db3 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:44.900210 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cf143bb5-2594-4017-8ccc-16723c5d2db3 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:44.965285 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-cf143bb5-2594-4017-8ccc-16723c5d2db3 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] HTTP exception thrown: Instance 7c7210e0-e5b6-4e95-9913-cc36e1f3b666 could not be found. Jan 15 02:45:44.966342 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-cf143bb5-2594-4017-8ccc-16723c5d2db3 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Returning 404 to user: Instance 7c7210e0-e5b6-4e95-9913-cc36e1f3b666 could not be found. {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:45:44.966934 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-cf143bb5-2594-4017-8ccc-16723c5d2db3 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666" status: 404 len: 111 microversion: 2.1 time: 0.091813 Jan 15 02:45:44.967941 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 319/663] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:44 2021] GET /compute/v2.1/servers/7c7210e0-e5b6-4e95-9913-cc36e1f3b666 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:45:44.998598 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-2e0f1f9f-3a14-4507-b2cd-d951649473c6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:45.008638 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2e0f1f9f-3a14-4507-b2cd-d951649473c6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432" status: 200 len: 1236 microversion: 2.1 time: 0.147830 Jan 15 02:45:45.009540 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 345/664] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:44 2021] GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432 => generated 1236 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:45.749052 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d5166452-bcf6-428c-aa70-b4911246d8b0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:45.749654 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d5166452-bcf6-428c-aa70-b4911246d8b0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:45.758406 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d5166452-bcf6-428c-aa70-b4911246d8b0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:45.758916 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d5166452-bcf6-428c-aa70-b4911246d8b0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:45.759761 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d5166452-bcf6-428c-aa70-b4911246d8b0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:45.760257 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d5166452-bcf6-428c-aa70-b4911246d8b0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:45.826150 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.objects.instance [None req-d5166452-bcf6-428c-aa70-b4911246d8b0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lazy-loading 'flavor' on Instance uuid 813b0cda-aa4a-4e8d-a4c7-2042b9415e81 {{(pid=94112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Jan 15 02:45:46.033795 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a7ed38c0-8335-45f2-bd6d-1762e81cb4bd tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:46.036281 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a7ed38c0-8335-45f2-bd6d-1762e81cb4bd tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:46.045288 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a7ed38c0-8335-45f2-bd6d-1762e81cb4bd tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:46.045784 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a7ed38c0-8335-45f2-bd6d-1762e81cb4bd tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:46.046622 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a7ed38c0-8335-45f2-bd6d-1762e81cb4bd tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:46.047113 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a7ed38c0-8335-45f2-bd6d-1762e81cb4bd tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:46.194975 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d5166452-bcf6-428c-aa70-b4911246d8b0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 202 len: 0 microversion: 2.20 time: 0.455009 Jan 15 02:45:46.197055 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 320/665] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:45:45 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 15 02:45:46.229741 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-52a2627e-ec51-43bb-96c5-8e4583fd30d6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:46.230611 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-52a2627e-ec51-43bb-96c5-8e4583fd30d6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:46.247643 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-52a2627e-ec51-43bb-96c5-8e4583fd30d6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:46.248152 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-52a2627e-ec51-43bb-96c5-8e4583fd30d6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:46.249126 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-52a2627e-ec51-43bb-96c5-8e4583fd30d6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:46.249815 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-52a2627e-ec51-43bb-96c5-8e4583fd30d6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:46.272326 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a7ed38c0-8335-45f2-bd6d-1762e81cb4bd tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:46.282549 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a7ed38c0-8335-45f2-bd6d-1762e81cb4bd tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432" status: 200 len: 1296 microversion: 2.1 time: 0.258095 Jan 15 02:45:46.283372 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 346/666] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:46 2021] GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432 => generated 1296 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:45:46.294643 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7b14da9c-3ca2-4b9d-9e27-c1586c093b6e tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:46.295239 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-7b14da9c-3ca2-4b9d-9e27-c1586c093b6e tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: d6f5f889-a811-42cd-915e-ecaa5ac5b1ed] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:46.304433 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7b14da9c-3ca2-4b9d-9e27-c1586c093b6e tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:46.304945 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7b14da9c-3ca2-4b9d-9e27-c1586c093b6e tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:46.305848 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7b14da9c-3ca2-4b9d-9e27-c1586c093b6e tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:46.306348 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7b14da9c-3ca2-4b9d-9e27-c1586c093b6e tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:46.388747 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-7b14da9c-3ca2-4b9d-9e27-c1586c093b6e tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: d6f5f889-a811-42cd-915e-ecaa5ac5b1ed] Going to try to terminate instance {{(pid=94111) delete /opt/stack/nova/nova/compute/api.py:2535}} Jan 15 02:45:46.519805 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-7b14da9c-3ca2-4b9d-9e27-c1586c093b6e tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "DELETE /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed" status: 204 len: 0 microversion: 2.1 time: 0.235023 Jan 15 02:45:46.520494 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 347/667] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:45:46 2021] DELETE /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 02:45:46.535589 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-131c94b7-b903-4917-b6b3-e8c759af201e tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:46.536393 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-131c94b7-b903-4917-b6b3-e8c759af201e tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: d6f5f889-a811-42cd-915e-ecaa5ac5b1ed] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:46.545270 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-131c94b7-b903-4917-b6b3-e8c759af201e tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:46.545610 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-131c94b7-b903-4917-b6b3-e8c759af201e tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:46.546482 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-131c94b7-b903-4917-b6b3-e8c759af201e tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:46.546977 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-131c94b7-b903-4917-b6b3-e8c759af201e tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:46.705530 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-52a2627e-ec51-43bb-96c5-8e4583fd30d6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:46.724408 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-52a2627e-ec51-43bb-96c5-8e4583fd30d6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:46.732124 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-52a2627e-ec51-43bb-96c5-8e4583fd30d6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:46.733603 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-52a2627e-ec51-43bb-96c5-8e4583fd30d6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1725 microversion: 2.20 time: 0.531139 Jan 15 02:45:46.734344 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 321/668] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:45:46 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1725 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:45:46.827053 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-131c94b7-b903-4917-b6b3-e8c759af201e tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:46.836905 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-131c94b7-b903-4917-b6b3-e8c759af201e tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed" status: 200 len: 1513 microversion: 2.1 time: 0.311691 Jan 15 02:45:46.837557 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 348/669] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:46 2021] GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed => generated 1513 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:47.307410 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e81f06d4-69b7-4b0f-870d-ba8a11338c0d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:47.308093 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e81f06d4-69b7-4b0f-870d-ba8a11338c0d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:47.317208 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e81f06d4-69b7-4b0f-870d-ba8a11338c0d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:47.317727 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e81f06d4-69b7-4b0f-870d-ba8a11338c0d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:47.318586 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e81f06d4-69b7-4b0f-870d-ba8a11338c0d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:47.319504 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e81f06d4-69b7-4b0f-870d-ba8a11338c0d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:47.761443 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6363f421-eaa3-41db-892f-202b1e2daedf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:47.762175 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6363f421-eaa3-41db-892f-202b1e2daedf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:47.771606 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6363f421-eaa3-41db-892f-202b1e2daedf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:47.772124 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6363f421-eaa3-41db-892f-202b1e2daedf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:47.772990 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6363f421-eaa3-41db-892f-202b1e2daedf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:47.773799 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6363f421-eaa3-41db-892f-202b1e2daedf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:48.010890 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e81f06d4-69b7-4b0f-870d-ba8a11338c0d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:48.021479 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e81f06d4-69b7-4b0f-870d-ba8a11338c0d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432" status: 200 len: 1362 microversion: 2.1 time: 0.723963 Jan 15 02:45:48.028356 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 322/670] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:47 2021] GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432 => generated 1362 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:48.033040 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6363f421-eaa3-41db-892f-202b1e2daedf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:48.036663 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b8e6d6e2-4b76-4f27-8db4-ca127646321d tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:48.037400 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b8e6d6e2-4b76-4f27-8db4-ca127646321d tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: d6f5f889-a811-42cd-915e-ecaa5ac5b1ed] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:48.045575 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b8e6d6e2-4b76-4f27-8db4-ca127646321d tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:48.046098 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b8e6d6e2-4b76-4f27-8db4-ca127646321d tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:48.046938 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b8e6d6e2-4b76-4f27-8db4-ca127646321d tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:48.047433 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b8e6d6e2-4b76-4f27-8db4-ca127646321d tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:48.049417 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6363f421-eaa3-41db-892f-202b1e2daedf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:48.056820 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6363f421-eaa3-41db-892f-202b1e2daedf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:48.058159 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6363f421-eaa3-41db-892f-202b1e2daedf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1725 microversion: 2.20 time: 0.307649 Jan 15 02:45:48.070463 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 349/671] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:45:47 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1725 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:45:48.539600 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b8e6d6e2-4b76-4f27-8db4-ca127646321d tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:48.548876 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b8e6d6e2-4b76-4f27-8db4-ca127646321d tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed" status: 200 len: 1513 microversion: 2.1 time: 0.525704 Jan 15 02:45:48.549575 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 323/672] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:48 2021] GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed => generated 1513 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:49.045436 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-227061cc-dd3e-4ba5-8e89-e118eb433e06 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:49.046360 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-227061cc-dd3e-4ba5-8e89-e118eb433e06 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:49.055777 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-227061cc-dd3e-4ba5-8e89-e118eb433e06 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:49.056557 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-227061cc-dd3e-4ba5-8e89-e118eb433e06 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:49.057433 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-227061cc-dd3e-4ba5-8e89-e118eb433e06 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:49.058080 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-227061cc-dd3e-4ba5-8e89-e118eb433e06 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:49.090189 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1b5f15b4-552f-4de0-af3b-4eca5a5d39e2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:49.091681 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1b5f15b4-552f-4de0-af3b-4eca5a5d39e2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:49.102292 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1b5f15b4-552f-4de0-af3b-4eca5a5d39e2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:49.102800 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1b5f15b4-552f-4de0-af3b-4eca5a5d39e2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:49.103686 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1b5f15b4-552f-4de0-af3b-4eca5a5d39e2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:49.104551 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1b5f15b4-552f-4de0-af3b-4eca5a5d39e2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:49.528925 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-227061cc-dd3e-4ba5-8e89-e118eb433e06 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:49.538608 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-227061cc-dd3e-4ba5-8e89-e118eb433e06 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432" status: 200 len: 1362 microversion: 2.1 time: 0.502341 Jan 15 02:45:49.539392 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 350/673] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:49 2021] GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432 => generated 1362 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:49.549736 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-85534aac-b0cc-4500-86f3-f72579ff6a7c req-9c8df031-d2aa-48cb-b342-23e868a88c53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f5f889-a811-42cd-915e-ecaa5ac5b1ed", "name": "network-vif-deleted", "tag": "72ec9465-1f3d-446b-b264-6927708f49da"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:49.558610 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:45:49.558610 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:45:49.570404 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-85534aac-b0cc-4500-86f3-f72579ff6a7c req-9c8df031-d2aa-48cb-b342-23e868a88c53 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:49.570909 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-85534aac-b0cc-4500-86f3-f72579ff6a7c req-9c8df031-d2aa-48cb-b342-23e868a88c53 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:49.589831 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-85534aac-b0cc-4500-86f3-f72579ff6a7c req-9c8df031-d2aa-48cb-b342-23e868a88c53 service nova] Creating event network-vif-deleted:72ec9465-1f3d-446b-b264-6927708f49da for instance d6f5f889-a811-42cd-915e-ecaa5ac5b1ed on hv-cinder-76330 Jan 15 02:45:49.595646 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-85534aac-b0cc-4500-86f3-f72579ff6a7c req-9c8df031-d2aa-48cb-b342-23e868a88c53 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054888 Jan 15 02:45:49.596568 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 351/674] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:45:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:45:49.607850 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-533d2dae-d58f-43b2-9ae6-0442ff8d17b7 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:49.608633 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-533d2dae-d58f-43b2-9ae6-0442ff8d17b7 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: d6f5f889-a811-42cd-915e-ecaa5ac5b1ed] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:49.618404 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-533d2dae-d58f-43b2-9ae6-0442ff8d17b7 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:49.618898 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-533d2dae-d58f-43b2-9ae6-0442ff8d17b7 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:49.619765 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-533d2dae-d58f-43b2-9ae6-0442ff8d17b7 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:49.620262 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-533d2dae-d58f-43b2-9ae6-0442ff8d17b7 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:49.654045 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1b5f15b4-552f-4de0-af3b-4eca5a5d39e2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:49.678908 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1b5f15b4-552f-4de0-af3b-4eca5a5d39e2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:49.686534 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1b5f15b4-552f-4de0-af3b-4eca5a5d39e2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:49.688029 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1b5f15b4-552f-4de0-af3b-4eca5a5d39e2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1725 microversion: 2.20 time: 0.613683 Jan 15 02:45:49.688976 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 324/675] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:45:49 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1725 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:45:49.710125 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-b5dac8af-e17a-470d-9f2c-5eaa81d815ee req-fd7175e2-565c-40b7-993c-d3043c8ae209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec845a88-1a81-4890-9963-9936491ed432", "tag": "a9e4c21b-46c5-4fe7-a02b-5c5ab9343130"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:49.717938 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:45:49.717938 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:45:49.733894 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-b5dac8af-e17a-470d-9f2c-5eaa81d815ee req-fd7175e2-565c-40b7-993c-d3043c8ae209 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:49.734787 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-b5dac8af-e17a-470d-9f2c-5eaa81d815ee req-fd7175e2-565c-40b7-993c-d3043c8ae209 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:49.744666 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-533d2dae-d58f-43b2-9ae6-0442ff8d17b7 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:49.745224 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-533d2dae-d58f-43b2-9ae6-0442ff8d17b7 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:49.745741 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.objects.instance [None req-533d2dae-d58f-43b2-9ae6-0442ff8d17b7 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lazy-loading 'fault' on Instance uuid d6f5f889-a811-42cd-915e-ecaa5ac5b1ed {{(pid=94111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Jan 15 02:45:49.755985 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-b5dac8af-e17a-470d-9f2c-5eaa81d815ee req-fd7175e2-565c-40b7-993c-d3043c8ae209 service nova] Creating event network-changed:a9e4c21b-46c5-4fe7-a02b-5c5ab9343130 for instance ec845a88-1a81-4890-9963-9936491ed432 on hv-cinder-76330 Jan 15 02:45:49.761536 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-b5dac8af-e17a-470d-9f2c-5eaa81d815ee req-fd7175e2-565c-40b7-993c-d3043c8ae209 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071071 Jan 15 02:45:49.762572 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 325/676] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:45:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:45:49.837870 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-533d2dae-d58f-43b2-9ae6-0442ff8d17b7 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:49.848024 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-533d2dae-d58f-43b2-9ae6-0442ff8d17b7 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed" status: 200 len: 1307 microversion: 2.1 time: 0.249066 Jan 15 02:45:49.848782 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 352/677] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:49 2021] GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed => generated 1307 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:50.563119 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-10bc9652-784e-431d-a186-c7ef088ae0b0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:50.563898 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-10bc9652-784e-431d-a186-c7ef088ae0b0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:50.573463 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-10bc9652-784e-431d-a186-c7ef088ae0b0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:50.573960 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-10bc9652-784e-431d-a186-c7ef088ae0b0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:50.574797 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-10bc9652-784e-431d-a186-c7ef088ae0b0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:50.575277 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-10bc9652-784e-431d-a186-c7ef088ae0b0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:50.714605 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b13d53f7-57ff-4b2c-abd9-050c6ce7e912 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:50.715282 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b13d53f7-57ff-4b2c-abd9-050c6ce7e912 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:50.723953 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b13d53f7-57ff-4b2c-abd9-050c6ce7e912 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:50.724464 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b13d53f7-57ff-4b2c-abd9-050c6ce7e912 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:50.725396 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b13d53f7-57ff-4b2c-abd9-050c6ce7e912 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:50.725935 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b13d53f7-57ff-4b2c-abd9-050c6ce7e912 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:50.982451 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b13d53f7-57ff-4b2c-abd9-050c6ce7e912 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:50.997868 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b13d53f7-57ff-4b2c-abd9-050c6ce7e912 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:51.005176 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b13d53f7-57ff-4b2c-abd9-050c6ce7e912 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:51.006430 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b13d53f7-57ff-4b2c-abd9-050c6ce7e912 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1725 microversion: 2.20 time: 0.301615 Jan 15 02:45:51.007023 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 353/678] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:45:50 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1725 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:45:51.018203 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9628ba63-c4d2-41de-91b8-5f444d8ded2f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:51.018203 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9628ba63-c4d2-41de-91b8-5f444d8ded2f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: d6f5f889-a811-42cd-915e-ecaa5ac5b1ed] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:51.027489 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9628ba63-c4d2-41de-91b8-5f444d8ded2f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:51.027996 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9628ba63-c4d2-41de-91b8-5f444d8ded2f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:51.028846 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9628ba63-c4d2-41de-91b8-5f444d8ded2f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:51.029370 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9628ba63-c4d2-41de-91b8-5f444d8ded2f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:51.086074 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-9628ba63-c4d2-41de-91b8-5f444d8ded2f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] HTTP exception thrown: Instance d6f5f889-a811-42cd-915e-ecaa5ac5b1ed could not be found. Jan 15 02:45:51.086746 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9628ba63-c4d2-41de-91b8-5f444d8ded2f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Returning 404 to user: Instance d6f5f889-a811-42cd-915e-ecaa5ac5b1ed could not be found. {{(pid=94111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:45:51.087645 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9628ba63-c4d2-41de-91b8-5f444d8ded2f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed" status: 404 len: 111 microversion: 2.1 time: 0.079536 Jan 15 02:45:51.088264 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 354/679] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:51 2021] GET /compute/v2.1/servers/d6f5f889-a811-42cd-915e-ecaa5ac5b1ed => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:45:51.098887 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-10bc9652-784e-431d-a186-c7ef088ae0b0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:51.104797 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c3491725-b514-4833-b670-62e8adfc935b tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:51.105632 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c3491725-b514-4833-b670-62e8adfc935b tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: adecaebf-3bf6-4dab-a332-5ff4fda684bb] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:51.108811 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-10bc9652-784e-431d-a186-c7ef088ae0b0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432" status: 200 len: 1362 microversion: 2.1 time: 0.555410 Jan 15 02:45:51.109735 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 326/680] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:50 2021] GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432 => generated 1362 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:51.115576 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c3491725-b514-4833-b670-62e8adfc935b tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:51.116102 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c3491725-b514-4833-b670-62e8adfc935b tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:51.116995 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c3491725-b514-4833-b670-62e8adfc935b tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:51.117523 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c3491725-b514-4833-b670-62e8adfc935b tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:51.192508 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c3491725-b514-4833-b670-62e8adfc935b tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: adecaebf-3bf6-4dab-a332-5ff4fda684bb] Going to try to terminate instance {{(pid=94111) delete /opt/stack/nova/nova/compute/api.py:2535}} Jan 15 02:45:51.322390 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c3491725-b514-4833-b670-62e8adfc935b tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "DELETE /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb" status: 204 len: 0 microversion: 2.1 time: 0.229323 Jan 15 02:45:51.323432 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 355/681] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:45:51 2021] DELETE /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 02:45:51.337792 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-900369f4-079a-4d03-af01-be5ef2704531 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:51.338468 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-900369f4-079a-4d03-af01-be5ef2704531 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: adecaebf-3bf6-4dab-a332-5ff4fda684bb] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:51.347356 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-900369f4-079a-4d03-af01-be5ef2704531 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:51.347866 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-900369f4-079a-4d03-af01-be5ef2704531 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:51.348739 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-900369f4-079a-4d03-af01-be5ef2704531 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:51.349266 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-900369f4-079a-4d03-af01-be5ef2704531 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:51.770388 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-900369f4-079a-4d03-af01-be5ef2704531 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:51.780329 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-900369f4-079a-4d03-af01-be5ef2704531 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb" status: 200 len: 1514 microversion: 2.1 time: 0.452011 Jan 15 02:45:51.780975 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 327/682] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:51 2021] GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb => generated 1514 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:52.032319 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1e9b2cfe-1dab-4019-983c-8c48a95adc81 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:52.033129 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1e9b2cfe-1dab-4019-983c-8c48a95adc81 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:52.042335 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1e9b2cfe-1dab-4019-983c-8c48a95adc81 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:52.042847 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1e9b2cfe-1dab-4019-983c-8c48a95adc81 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:52.043690 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1e9b2cfe-1dab-4019-983c-8c48a95adc81 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:52.044183 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1e9b2cfe-1dab-4019-983c-8c48a95adc81 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:52.132740 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-893ff9b8-15cb-467c-a62d-b29d650c6b8b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:52.133435 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-893ff9b8-15cb-467c-a62d-b29d650c6b8b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:52.141372 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-893ff9b8-15cb-467c-a62d-b29d650c6b8b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:52.141880 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-893ff9b8-15cb-467c-a62d-b29d650c6b8b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:52.142721 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-893ff9b8-15cb-467c-a62d-b29d650c6b8b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:52.143213 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-893ff9b8-15cb-467c-a62d-b29d650c6b8b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:52.287226 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1e9b2cfe-1dab-4019-983c-8c48a95adc81 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:52.302103 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1e9b2cfe-1dab-4019-983c-8c48a95adc81 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:52.308820 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1e9b2cfe-1dab-4019-983c-8c48a95adc81 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:52.310073 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1e9b2cfe-1dab-4019-983c-8c48a95adc81 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1725 microversion: 2.20 time: 0.287791 Jan 15 02:45:52.310664 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 356/683] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:45:52 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1725 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:45:52.387986 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-893ff9b8-15cb-467c-a62d-b29d650c6b8b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:52.397439 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-893ff9b8-15cb-467c-a62d-b29d650c6b8b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432" status: 200 len: 1362 microversion: 2.1 time: 0.274380 Jan 15 02:45:52.398034 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 328/684] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:52 2021] GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:45:52.805807 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-372142a5-c34e-445b-8eab-dd4dfd04f8e5 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:52.806477 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-372142a5-c34e-445b-8eab-dd4dfd04f8e5 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: adecaebf-3bf6-4dab-a332-5ff4fda684bb] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:52.814689 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-372142a5-c34e-445b-8eab-dd4dfd04f8e5 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:52.815194 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-372142a5-c34e-445b-8eab-dd4dfd04f8e5 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:52.816811 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-372142a5-c34e-445b-8eab-dd4dfd04f8e5 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:52.817356 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-372142a5-c34e-445b-8eab-dd4dfd04f8e5 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:52.879881 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-642e24b1-c8b9-4ee3-aee6-ff7bc1d050bb req-865634f9-3ce7-4241-844a-048c70e603a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec845a88-1a81-4890-9963-9936491ed432", "name": "network-vif-plugged", "status": "completed", "tag": "a9e4c21b-46c5-4fe7-a02b-5c5ab9343130"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:52.887026 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:45:52.887026 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:45:52.896540 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-642e24b1-c8b9-4ee3-aee6-ff7bc1d050bb req-865634f9-3ce7-4241-844a-048c70e603a6 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:52.896952 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-642e24b1-c8b9-4ee3-aee6-ff7bc1d050bb req-865634f9-3ce7-4241-844a-048c70e603a6 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:52.916020 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-642e24b1-c8b9-4ee3-aee6-ff7bc1d050bb req-865634f9-3ce7-4241-844a-048c70e603a6 service nova] Creating event network-vif-plugged:a9e4c21b-46c5-4fe7-a02b-5c5ab9343130 for instance ec845a88-1a81-4890-9963-9936491ed432 on hv-cinder-76330 Jan 15 02:45:52.921313 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-642e24b1-c8b9-4ee3-aee6-ff7bc1d050bb req-865634f9-3ce7-4241-844a-048c70e603a6 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051052 Jan 15 02:45:52.921986 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 329/685] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:45:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:45:53.065699 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-372142a5-c34e-445b-8eab-dd4dfd04f8e5 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:53.074776 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-372142a5-c34e-445b-8eab-dd4dfd04f8e5 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb" status: 200 len: 1514 microversion: 2.1 time: 0.278759 Jan 15 02:45:53.075387 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 357/686] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:52 2021] GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb => generated 1514 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:53.338278 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-43acfff8-9425-49a6-9d26-e55c3a8a2edb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:53.338624 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-43acfff8-9425-49a6-9d26-e55c3a8a2edb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:53.347796 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-43acfff8-9425-49a6-9d26-e55c3a8a2edb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:53.349604 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-43acfff8-9425-49a6-9d26-e55c3a8a2edb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:53.349604 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-43acfff8-9425-49a6-9d26-e55c3a8a2edb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:53.349922 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-43acfff8-9425-49a6-9d26-e55c3a8a2edb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:53.422266 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6cffcbea-0afa-451a-9cc1-b5e3a6b8a98d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:53.423050 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6cffcbea-0afa-451a-9cc1-b5e3a6b8a98d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:53.432202 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6cffcbea-0afa-451a-9cc1-b5e3a6b8a98d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:53.432720 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6cffcbea-0afa-451a-9cc1-b5e3a6b8a98d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:53.433707 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6cffcbea-0afa-451a-9cc1-b5e3a6b8a98d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:53.434195 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6cffcbea-0afa-451a-9cc1-b5e3a6b8a98d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:53.686985 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6cffcbea-0afa-451a-9cc1-b5e3a6b8a98d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:53.696887 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6cffcbea-0afa-451a-9cc1-b5e3a6b8a98d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432" status: 200 len: 1362 microversion: 2.1 time: 0.284316 Jan 15 02:45:53.697630 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 358/687] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:53 2021] GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432 => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:53.889919 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-43acfff8-9425-49a6-9d26-e55c3a8a2edb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:53.905584 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-43acfff8-9425-49a6-9d26-e55c3a8a2edb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:53.912757 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-43acfff8-9425-49a6-9d26-e55c3a8a2edb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:53.914005 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-43acfff8-9425-49a6-9d26-e55c3a8a2edb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1725 microversion: 2.20 time: 0.587088 Jan 15 02:45:53.914603 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 330/688] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:45:53 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1725 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:45:54.099182 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-59c2c118-34fd-4b65-9bc2-1cf0ad18e9a4 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:54.099847 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-59c2c118-34fd-4b65-9bc2-1cf0ad18e9a4 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: adecaebf-3bf6-4dab-a332-5ff4fda684bb] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:54.107939 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-59c2c118-34fd-4b65-9bc2-1cf0ad18e9a4 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:54.108455 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-59c2c118-34fd-4b65-9bc2-1cf0ad18e9a4 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:54.109340 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-59c2c118-34fd-4b65-9bc2-1cf0ad18e9a4 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:54.109831 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-59c2c118-34fd-4b65-9bc2-1cf0ad18e9a4 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:54.219234 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-a2eff716-e4bc-4316-bb48-ec29c53815fc req-79efbbf1-cf19-4961-a45c-02930ce58c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adecaebf-3bf6-4dab-a332-5ff4fda684bb", "name": "network-vif-deleted", "tag": "51517f2a-fb1a-48a0-99d4-4b4cdfb90916"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:54.227732 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:45:54.227732 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:45:54.239010 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-a2eff716-e4bc-4316-bb48-ec29c53815fc req-79efbbf1-cf19-4961-a45c-02930ce58c5e service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:54.239688 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-a2eff716-e4bc-4316-bb48-ec29c53815fc req-79efbbf1-cf19-4961-a45c-02930ce58c5e service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:54.260751 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-a2eff716-e4bc-4316-bb48-ec29c53815fc req-79efbbf1-cf19-4961-a45c-02930ce58c5e service nova] Creating event network-vif-deleted:51517f2a-fb1a-48a0-99d4-4b4cdfb90916 for instance adecaebf-3bf6-4dab-a332-5ff4fda684bb on hv-cinder-76330 Jan 15 02:45:54.267633 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-a2eff716-e4bc-4316-bb48-ec29c53815fc req-79efbbf1-cf19-4961-a45c-02930ce58c5e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060329 Jan 15 02:45:54.268521 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 331/689] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:45:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:45:54.485980 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-59c2c118-34fd-4b65-9bc2-1cf0ad18e9a4 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:54.500298 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-59c2c118-34fd-4b65-9bc2-1cf0ad18e9a4 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb" status: 200 len: 1472 microversion: 2.1 time: 0.410498 Jan 15 02:45:54.501380 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 359/690] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:54 2021] GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb => generated 1472 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:54.723115 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2d78b1cb-f566-4136-bfff-0568455f4a5a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:54.723932 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2d78b1cb-f566-4136-bfff-0568455f4a5a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:54.733153 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2d78b1cb-f566-4136-bfff-0568455f4a5a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:54.733667 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2d78b1cb-f566-4136-bfff-0568455f4a5a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:54.734524 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2d78b1cb-f566-4136-bfff-0568455f4a5a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:54.735020 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2d78b1cb-f566-4136-bfff-0568455f4a5a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:54.939006 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3fe5794f-6b68-47fc-8532-fdccb8d5161b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:54.939698 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3fe5794f-6b68-47fc-8532-fdccb8d5161b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:54.948425 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3fe5794f-6b68-47fc-8532-fdccb8d5161b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:54.948934 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3fe5794f-6b68-47fc-8532-fdccb8d5161b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:54.949947 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3fe5794f-6b68-47fc-8532-fdccb8d5161b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:54.950473 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3fe5794f-6b68-47fc-8532-fdccb8d5161b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:54.992389 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-2d78b1cb-f566-4136-bfff-0568455f4a5a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:55.001553 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2d78b1cb-f566-4136-bfff-0568455f4a5a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432" status: 200 len: 1549 microversion: 2.1 time: 0.289400 Jan 15 02:45:55.002349 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 332/691] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:54 2021] GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432 => generated 1549 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:55.025256 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d36b96cf-254f-4bf1-b080-961241cf8c66 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:55.025491 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d36b96cf-254f-4bf1-b080-961241cf8c66 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:55.033304 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d36b96cf-254f-4bf1-b080-961241cf8c66 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:55.033781 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d36b96cf-254f-4bf1-b080-961241cf8c66 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:55.035453 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d36b96cf-254f-4bf1-b080-961241cf8c66 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:55.035934 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d36b96cf-254f-4bf1-b080-961241cf8c66 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:55.203092 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3fe5794f-6b68-47fc-8532-fdccb8d5161b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:55.218581 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3fe5794f-6b68-47fc-8532-fdccb8d5161b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:55.220000 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d36b96cf-254f-4bf1-b080-961241cf8c66 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.204982 Jan 15 02:45:55.220656 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 333/692] 10.222.0.37 () {58 vars in 1265 bytes} [Fri Jan 15 02:45:55 2021] GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/os-interface => generated 285 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:45:55.225524 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3fe5794f-6b68-47fc-8532-fdccb8d5161b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:55.226734 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3fe5794f-6b68-47fc-8532-fdccb8d5161b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1725 microversion: 2.20 time: 0.296955 Jan 15 02:45:55.227465 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 360/693] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:45:54 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1725 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:45:55.525605 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b3ce7326-a8d0-4897-8ac2-8c7dd027a6c8 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:55.526275 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b3ce7326-a8d0-4897-8ac2-8c7dd027a6c8 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: adecaebf-3bf6-4dab-a332-5ff4fda684bb] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:55.534877 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b3ce7326-a8d0-4897-8ac2-8c7dd027a6c8 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:55.535586 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b3ce7326-a8d0-4897-8ac2-8c7dd027a6c8 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:55.536433 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b3ce7326-a8d0-4897-8ac2-8c7dd027a6c8 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:55.536927 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b3ce7326-a8d0-4897-8ac2-8c7dd027a6c8 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:55.590404 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-b3ce7326-a8d0-4897-8ac2-8c7dd027a6c8 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] HTTP exception thrown: Instance adecaebf-3bf6-4dab-a332-5ff4fda684bb could not be found. Jan 15 02:45:55.591070 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b3ce7326-a8d0-4897-8ac2-8c7dd027a6c8 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Returning 404 to user: Instance adecaebf-3bf6-4dab-a332-5ff4fda684bb could not be found. {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:45:55.591976 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b3ce7326-a8d0-4897-8ac2-8c7dd027a6c8 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb" status: 404 len: 111 microversion: 2.1 time: 0.076813 Jan 15 02:45:55.592596 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 334/694] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:55 2021] GET /compute/v2.1/servers/adecaebf-3bf6-4dab-a332-5ff4fda684bb => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:45:56.252191 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-01ad5b5b-b7e6-430c-9928-9d5c88c1099d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:56.254173 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-01ad5b5b-b7e6-430c-9928-9d5c88c1099d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:56.262226 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-01ad5b5b-b7e6-430c-9928-9d5c88c1099d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:56.262710 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-01ad5b5b-b7e6-430c-9928-9d5c88c1099d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:56.263564 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-01ad5b5b-b7e6-430c-9928-9d5c88c1099d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:56.264055 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-01ad5b5b-b7e6-430c-9928-9d5c88c1099d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:56.541562 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-01ad5b5b-b7e6-430c-9928-9d5c88c1099d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:56.562879 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-01ad5b5b-b7e6-430c-9928-9d5c88c1099d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:56.571006 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-01ad5b5b-b7e6-430c-9928-9d5c88c1099d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:56.572336 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-01ad5b5b-b7e6-430c-9928-9d5c88c1099d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1725 microversion: 2.20 time: 0.329380 Jan 15 02:45:56.573211 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 361/695] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:45:56 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1725 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:45:56.854656 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-8918c313-9f55-4a57-b2cc-c86283773e99 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:56.855257 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8918c313-9f55-4a57-b2cc-c86283773e99 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 1e1481d5-324e-4893-b3fa-9815f0688933] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:56.864163 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8918c313-9f55-4a57-b2cc-c86283773e99 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:56.864675 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8918c313-9f55-4a57-b2cc-c86283773e99 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:56.865579 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8918c313-9f55-4a57-b2cc-c86283773e99 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:56.866112 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8918c313-9f55-4a57-b2cc-c86283773e99 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:56.942988 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8918c313-9f55-4a57-b2cc-c86283773e99 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 1e1481d5-324e-4893-b3fa-9815f0688933] Going to try to terminate instance {{(pid=94112) delete /opt/stack/nova/nova/compute/api.py:2535}} Jan 15 02:45:57.068600 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-8918c313-9f55-4a57-b2cc-c86283773e99 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "DELETE /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933" status: 204 len: 0 microversion: 2.1 time: 0.223367 Jan 15 02:45:57.069602 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 335/696] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:45:56 2021] DELETE /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 02:45:57.083183 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-de750fb2-39ca-4ad1-9a90-c8b3219a6c47 req-3cc5a114-32c6-45b7-8041-c1649866d783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec845a88-1a81-4890-9963-9936491ed432", "tag": "a9e4c21b-46c5-4fe7-a02b-5c5ab9343130"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:57.090001 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:45:57.090001 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:45:57.100184 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-de750fb2-39ca-4ad1-9a90-c8b3219a6c47 req-3cc5a114-32c6-45b7-8041-c1649866d783 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:57.100703 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-de750fb2-39ca-4ad1-9a90-c8b3219a6c47 req-3cc5a114-32c6-45b7-8041-c1649866d783 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:57.118929 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-de750fb2-39ca-4ad1-9a90-c8b3219a6c47 req-3cc5a114-32c6-45b7-8041-c1649866d783 service nova] Creating event network-changed:a9e4c21b-46c5-4fe7-a02b-5c5ab9343130 for instance ec845a88-1a81-4890-9963-9936491ed432 on hv-cinder-76330 Jan 15 02:45:57.124104 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-de750fb2-39ca-4ad1-9a90-c8b3219a6c47 req-3cc5a114-32c6-45b7-8041-c1649866d783 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052995 Jan 15 02:45:57.125119 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 336/697] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:45:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:45:57.136009 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d5cc07cd-c9b2-430e-9292-5f5ffd47a58f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:57.136782 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d5cc07cd-c9b2-430e-9292-5f5ffd47a58f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 1e1481d5-324e-4893-b3fa-9815f0688933] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:57.145399 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d5cc07cd-c9b2-430e-9292-5f5ffd47a58f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:57.145914 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d5cc07cd-c9b2-430e-9292-5f5ffd47a58f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:57.147046 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d5cc07cd-c9b2-430e-9292-5f5ffd47a58f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:57.147829 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d5cc07cd-c9b2-430e-9292-5f5ffd47a58f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:57.179674 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a6d447cd-e907-4ebb-8420-15e0a3d18d73 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:57.181131 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a6d447cd-e907-4ebb-8420-15e0a3d18d73 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:57.191957 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a6d447cd-e907-4ebb-8420-15e0a3d18d73 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:57.192749 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a6d447cd-e907-4ebb-8420-15e0a3d18d73 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:57.193839 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a6d447cd-e907-4ebb-8420-15e0a3d18d73 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:57.194467 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a6d447cd-e907-4ebb-8420-15e0a3d18d73 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:57.336022 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a6d447cd-e907-4ebb-8420-15e0a3d18d73 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 14 microversion: 2.1 time: 0.344623 Jan 15 02:45:57.336919 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 362/698] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:45:56 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 14 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:45:57.598350 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6e13e844-2561-41ff-9053-7ad320bd13b6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:57.599162 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6e13e844-2561-41ff-9053-7ad320bd13b6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:57.608132 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6e13e844-2561-41ff-9053-7ad320bd13b6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:57.608737 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6e13e844-2561-41ff-9053-7ad320bd13b6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:57.609703 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6e13e844-2561-41ff-9053-7ad320bd13b6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:57.610277 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6e13e844-2561-41ff-9053-7ad320bd13b6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:57.645652 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d5cc07cd-c9b2-430e-9292-5f5ffd47a58f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:57.657785 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d5cc07cd-c9b2-430e-9292-5f5ffd47a58f tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933" status: 200 len: 1513 microversion: 2.1 time: 0.531390 Jan 15 02:45:57.658735 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 337/699] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:57 2021] GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933 => generated 1513 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:57.801646 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5c69eac4-687f-499d-8c42-8380037eccdf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:57.802767 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5c69eac4-687f-499d-8c42-8380037eccdf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:57.819936 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5c69eac4-687f-499d-8c42-8380037eccdf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:57.820840 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5c69eac4-687f-499d-8c42-8380037eccdf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:57.822508 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5c69eac4-687f-499d-8c42-8380037eccdf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:57.823488 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5c69eac4-687f-499d-8c42-8380037eccdf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:57.936929 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6e13e844-2561-41ff-9053-7ad320bd13b6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:57.958846 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6e13e844-2561-41ff-9053-7ad320bd13b6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:57.965825 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.objects.instance [None req-5c69eac4-687f-499d-8c42-8380037eccdf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lazy-loading 'flavor' on Instance uuid 19d658a3-85b8-4130-b672-9843892a6fa5 {{(pid=94112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Jan 15 02:45:57.966782 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6e13e844-2561-41ff-9053-7ad320bd13b6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:57.968241 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6e13e844-2561-41ff-9053-7ad320bd13b6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1725 microversion: 2.20 time: 0.380144 Jan 15 02:45:57.969369 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 363/700] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:45:57 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1725 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:45:58.130862 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5c69eac4-687f-499d-8c42-8380037eccdf tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "POST /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5/action" status: 202 len: 0 microversion: 2.1 time: 0.353490 Jan 15 02:45:58.131638 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 338/701] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:45:57 2021] POST /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:45:58.145961 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-64564eba-6736-4cca-99c0-d20e8001b4f5 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:58.146197 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-64564eba-6736-4cca-99c0-d20e8001b4f5 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:58.166800 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-64564eba-6736-4cca-99c0-d20e8001b4f5 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:58.166800 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-64564eba-6736-4cca-99c0-d20e8001b4f5 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:58.167447 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-64564eba-6736-4cca-99c0-d20e8001b4f5 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:58.167932 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-64564eba-6736-4cca-99c0-d20e8001b4f5 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:58.354674 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-491f2b53-b85d-458b-bff9-564c41dc7918 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:58.356014 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-491f2b53-b85d-458b-bff9-564c41dc7918 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:58.365146 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-491f2b53-b85d-458b-bff9-564c41dc7918 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:58.365761 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-491f2b53-b85d-458b-bff9-564c41dc7918 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:58.366622 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-491f2b53-b85d-458b-bff9-564c41dc7918 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:58.367121 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-491f2b53-b85d-458b-bff9-564c41dc7918 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:58.426113 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-64564eba-6736-4cca-99c0-d20e8001b4f5 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:58.435326 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-64564eba-6736-4cca-99c0-d20e8001b4f5 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1574 microversion: 2.1 time: 0.299014 Jan 15 02:45:58.436146 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 364/702] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:58 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1574 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:58.512108 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-491f2b53-b85d-458b-bff9-564c41dc7918 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 14 microversion: 2.1 time: 0.168105 Jan 15 02:45:58.512980 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 339/703] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:45:58 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 02:45:58.682343 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e3461267-f72a-43c1-adaf-cbb52df77085 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:58.683026 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e3461267-f72a-43c1-adaf-cbb52df77085 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 1e1481d5-324e-4893-b3fa-9815f0688933] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:58.692069 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e3461267-f72a-43c1-adaf-cbb52df77085 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:58.692581 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e3461267-f72a-43c1-adaf-cbb52df77085 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:58.693449 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e3461267-f72a-43c1-adaf-cbb52df77085 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:58.693941 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e3461267-f72a-43c1-adaf-cbb52df77085 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:58.945586 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e3461267-f72a-43c1-adaf-cbb52df77085 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:58.954533 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e3461267-f72a-43c1-adaf-cbb52df77085 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933" status: 200 len: 1513 microversion: 2.1 time: 0.282558 Jan 15 02:45:58.955119 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 365/704] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:58 2021] GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933 => generated 1513 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:58.994959 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-18b20e95-4ad2-44f2-803f-5fcdae9b773b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:58.995725 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-18b20e95-4ad2-44f2-803f-5fcdae9b773b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:59.004523 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-18b20e95-4ad2-44f2-803f-5fcdae9b773b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:59.005038 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-18b20e95-4ad2-44f2-803f-5fcdae9b773b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:59.005879 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-18b20e95-4ad2-44f2-803f-5fcdae9b773b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:59.006368 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-18b20e95-4ad2-44f2-803f-5fcdae9b773b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:59.433840 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-18b20e95-4ad2-44f2-803f-5fcdae9b773b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:59.450164 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-18b20e95-4ad2-44f2-803f-5fcdae9b773b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:59.456942 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-18b20e95-4ad2-44f2-803f-5fcdae9b773b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:59.458231 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-18b20e95-4ad2-44f2-803f-5fcdae9b773b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1725 microversion: 2.20 time: 0.474097 Jan 15 02:45:59.458855 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 340/705] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:45:58 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1725 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:45:59.461303 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-74830511-2095-41a9-8eb6-02f3d50d4638 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:59.461975 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-74830511-2095-41a9-8eb6-02f3d50d4638 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:59.470152 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-74830511-2095-41a9-8eb6-02f3d50d4638 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:59.470662 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-74830511-2095-41a9-8eb6-02f3d50d4638 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:59.471554 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-74830511-2095-41a9-8eb6-02f3d50d4638 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:59.472084 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-74830511-2095-41a9-8eb6-02f3d50d4638 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:59.530243 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-fa014621-5fe2-4396-9b54-a13266728e15 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:45:59.531299 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-fa014621-5fe2-4396-9b54-a13266728e15 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:59.539921 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fa014621-5fe2-4396-9b54-a13266728e15 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:59.540428 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fa014621-5fe2-4396-9b54-a13266728e15 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:59.541319 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fa014621-5fe2-4396-9b54-a13266728e15 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:59.541873 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fa014621-5fe2-4396-9b54-a13266728e15 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:59.680731 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-fa014621-5fe2-4396-9b54-a13266728e15 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 14 microversion: 2.1 time: 0.160827 Jan 15 02:45:59.681511 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 341/706] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:45:59 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:45:59.735304 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-74830511-2095-41a9-8eb6-02f3d50d4638 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:45:59.745610 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-74830511-2095-41a9-8eb6-02f3d50d4638 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1574 microversion: 2.1 time: 0.293529 Jan 15 02:45:59.746328 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 366/707] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:59 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1574 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:45:59.979906 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ec8ce7f3-dbdc-4610-a623-f2d156c8887e tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:45:59.980732 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ec8ce7f3-dbdc-4610-a623-f2d156c8887e tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 1e1481d5-324e-4893-b3fa-9815f0688933] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:45:59.990410 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ec8ce7f3-dbdc-4610-a623-f2d156c8887e tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:59.990918 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ec8ce7f3-dbdc-4610-a623-f2d156c8887e tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:45:59.991819 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ec8ce7f3-dbdc-4610-a623-f2d156c8887e tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:45:59.992309 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ec8ce7f3-dbdc-4610-a623-f2d156c8887e tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:00.188871 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-ec8ce7f3-dbdc-4610-a623-f2d156c8887e tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63160ec41a3b4c9e839a6aefe3c269d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd56ed8011104bf0a99ad88d8911ead9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:00.197820 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ec8ce7f3-dbdc-4610-a623-f2d156c8887e tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933" status: 200 len: 1471 microversion: 2.1 time: 0.228531 Jan 15 02:46:00.198423 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 342/708] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:45:59 2021] GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933 => generated 1471 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:46:00.279592 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-9ee7bf47-38eb-4f67-a726-99ad1812f02e req-bf7546aa-344b-42c2-b85b-c9ff9b50b1ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e1481d5-324e-4893-b3fa-9815f0688933", "name": "network-vif-deleted", "tag": "4d1d06ee-8d7d-488b-b0e5-bf3a82f8ed58"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:00.287626 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:46:00.287626 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:46:00.298324 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-9ee7bf47-38eb-4f67-a726-99ad1812f02e req-bf7546aa-344b-42c2-b85b-c9ff9b50b1ab service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:00.298904 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-9ee7bf47-38eb-4f67-a726-99ad1812f02e req-bf7546aa-344b-42c2-b85b-c9ff9b50b1ab service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:00.318279 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-9ee7bf47-38eb-4f67-a726-99ad1812f02e req-bf7546aa-344b-42c2-b85b-c9ff9b50b1ab service nova] Creating event network-vif-deleted:4d1d06ee-8d7d-488b-b0e5-bf3a82f8ed58 for instance 1e1481d5-324e-4893-b3fa-9815f0688933 on hv-cinder-76330 Jan 15 02:46:00.323809 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-9ee7bf47-38eb-4f67-a726-99ad1812f02e req-bf7546aa-344b-42c2-b85b-c9ff9b50b1ab service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055050 Jan 15 02:46:00.324550 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 367/709] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:46:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:46:00.484404 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-59a10169-d32f-42f5-9f63-0357f147f183 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:00.485284 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-59a10169-d32f-42f5-9f63-0357f147f183 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:00.494343 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-59a10169-d32f-42f5-9f63-0357f147f183 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:00.494853 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-59a10169-d32f-42f5-9f63-0357f147f183 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:00.495706 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-59a10169-d32f-42f5-9f63-0357f147f183 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:00.496202 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-59a10169-d32f-42f5-9f63-0357f147f183 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:00.700418 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4eb5f454-4ab3-473c-a82f-05e2d0e89594 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:00.701729 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4eb5f454-4ab3-473c-a82f-05e2d0e89594 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:00.711333 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4eb5f454-4ab3-473c-a82f-05e2d0e89594 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:00.711799 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4eb5f454-4ab3-473c-a82f-05e2d0e89594 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:00.712648 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4eb5f454-4ab3-473c-a82f-05e2d0e89594 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:00.713160 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4eb5f454-4ab3-473c-a82f-05e2d0e89594 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:00.879133 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4eb5f454-4ab3-473c-a82f-05e2d0e89594 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 14 microversion: 2.1 time: 0.188759 Jan 15 02:46:00.880438 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 368/710] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:00 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 14 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:46:00.892057 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4b006cd1-4ee0-40c8-8611-91eff839ea8a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:00.892978 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4b006cd1-4ee0-40c8-8611-91eff839ea8a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:00.902421 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4b006cd1-4ee0-40c8-8611-91eff839ea8a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:00.903021 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4b006cd1-4ee0-40c8-8611-91eff839ea8a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:00.904037 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4b006cd1-4ee0-40c8-8611-91eff839ea8a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:00.904629 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4b006cd1-4ee0-40c8-8611-91eff839ea8a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:00.961182 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-59a10169-d32f-42f5-9f63-0357f147f183 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:00.981585 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-59a10169-d32f-42f5-9f63-0357f147f183 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:00.991839 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-59a10169-d32f-42f5-9f63-0357f147f183 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:00.993661 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-59a10169-d32f-42f5-9f63-0357f147f183 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1725 microversion: 2.20 time: 0.519928 Jan 15 02:46:00.994887 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 343/711] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:00 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1725 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:46:01.200261 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4b006cd1-4ee0-40c8-8611-91eff839ea8a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:01.210326 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4b006cd1-4ee0-40c8-8611-91eff839ea8a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1574 microversion: 2.1 time: 0.328295 Jan 15 02:46:01.210956 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 369/712] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:00 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1574 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:46:01.222616 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1fcf5799-090c-4513-a381-1646beec11e6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:01.223367 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1fcf5799-090c-4513-a381-1646beec11e6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] [instance: 1e1481d5-324e-4893-b3fa-9815f0688933] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:01.232486 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1fcf5799-090c-4513-a381-1646beec11e6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:01.233036 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1fcf5799-090c-4513-a381-1646beec11e6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:01.233929 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1fcf5799-090c-4513-a381-1646beec11e6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:01.234494 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1fcf5799-090c-4513-a381-1646beec11e6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:01.288602 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-1fcf5799-090c-4513-a381-1646beec11e6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] HTTP exception thrown: Instance 1e1481d5-324e-4893-b3fa-9815f0688933 could not be found. Jan 15 02:46:01.289304 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1fcf5799-090c-4513-a381-1646beec11e6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] Returning 404 to user: Instance 1e1481d5-324e-4893-b3fa-9815f0688933 could not be found. {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:46:01.290232 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1fcf5799-090c-4513-a381-1646beec11e6 tempest-AttachVolumeNegativeTest-1938232506 tempest-AttachVolumeNegativeTest-1938232506] 10.222.0.37 "GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933" status: 404 len: 111 microversion: 2.1 time: 0.077430 Jan 15 02:46:01.290855 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 344/713] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:01 2021] GET /compute/v2.1/servers/1e1481d5-324e-4893-b3fa-9815f0688933 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 02:46:01.898570 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-221d227d-0bf9-48f1-9d1f-0efdaa31e912 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:01.899629 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-221d227d-0bf9-48f1-9d1f-0efdaa31e912 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:01.909170 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-221d227d-0bf9-48f1-9d1f-0efdaa31e912 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:01.909654 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-221d227d-0bf9-48f1-9d1f-0efdaa31e912 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:01.910693 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-221d227d-0bf9-48f1-9d1f-0efdaa31e912 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:01.911195 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-221d227d-0bf9-48f1-9d1f-0efdaa31e912 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:02.020869 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e10b4aaa-c3a7-4bf8-8fef-9d7d5a830793 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:02.021583 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e10b4aaa-c3a7-4bf8-8fef-9d7d5a830793 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:02.029862 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e10b4aaa-c3a7-4bf8-8fef-9d7d5a830793 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:02.030354 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e10b4aaa-c3a7-4bf8-8fef-9d7d5a830793 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:02.031415 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e10b4aaa-c3a7-4bf8-8fef-9d7d5a830793 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:02.031968 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e10b4aaa-c3a7-4bf8-8fef-9d7d5a830793 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:02.053688 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-221d227d-0bf9-48f1-9d1f-0efdaa31e912 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 14 microversion: 2.1 time: 0.165525 Jan 15 02:46:02.057402 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 370/714] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:01 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 14 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:46:02.236886 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-65154814-cd0b-41b6-8ee0-e505bc154968 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:02.237834 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-65154814-cd0b-41b6-8ee0-e505bc154968 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:02.247199 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-65154814-cd0b-41b6-8ee0-e505bc154968 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:02.248094 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-65154814-cd0b-41b6-8ee0-e505bc154968 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:02.249088 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-65154814-cd0b-41b6-8ee0-e505bc154968 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:02.249641 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-65154814-cd0b-41b6-8ee0-e505bc154968 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:02.279696 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e10b4aaa-c3a7-4bf8-8fef-9d7d5a830793 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:02.296545 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e10b4aaa-c3a7-4bf8-8fef-9d7d5a830793 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:02.303610 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e10b4aaa-c3a7-4bf8-8fef-9d7d5a830793 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:02.305066 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e10b4aaa-c3a7-4bf8-8fef-9d7d5a830793 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1746 microversion: 2.20 time: 0.294271 Jan 15 02:46:02.305781 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 345/715] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:02 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1746 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:46:02.803732 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-65154814-cd0b-41b6-8ee0-e505bc154968 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:02.821893 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-65154814-cd0b-41b6-8ee0-e505bc154968 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1574 microversion: 2.1 time: 0.594351 Jan 15 02:46:02.823247 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 371/716] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:02 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1574 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:46:03.071394 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-bc8802c7-2b3b-4325-aad6-864835e87228 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:03.072455 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-bc8802c7-2b3b-4325-aad6-864835e87228 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:03.080534 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bc8802c7-2b3b-4325-aad6-864835e87228 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:03.081396 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bc8802c7-2b3b-4325-aad6-864835e87228 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:03.082244 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bc8802c7-2b3b-4325-aad6-864835e87228 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:03.082739 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bc8802c7-2b3b-4325-aad6-864835e87228 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:03.223031 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-bc8802c7-2b3b-4325-aad6-864835e87228 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 14 microversion: 2.1 time: 0.161334 Jan 15 02:46:03.223729 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 346/717] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:03 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:46:03.329498 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-148ae955-14dd-405d-9a4e-be2404f1e9c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:03.330165 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-148ae955-14dd-405d-9a4e-be2404f1e9c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:03.338592 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-148ae955-14dd-405d-9a4e-be2404f1e9c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:03.339098 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-148ae955-14dd-405d-9a4e-be2404f1e9c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:03.339938 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-148ae955-14dd-405d-9a4e-be2404f1e9c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:03.340505 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-148ae955-14dd-405d-9a4e-be2404f1e9c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:03.694409 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-148ae955-14dd-405d-9a4e-be2404f1e9c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:03.709922 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-148ae955-14dd-405d-9a4e-be2404f1e9c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:03.718769 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-148ae955-14dd-405d-9a4e-be2404f1e9c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:03.720582 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-148ae955-14dd-405d-9a4e-be2404f1e9c6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1746 microversion: 2.20 time: 0.399597 Jan 15 02:46:03.731881 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 372/718] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:03 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1746 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:46:03.860636 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5a0f2a87-a79b-43f8-81e6-3f80a2b91135 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:03.861626 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5a0f2a87-a79b-43f8-81e6-3f80a2b91135 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:03.871949 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5a0f2a87-a79b-43f8-81e6-3f80a2b91135 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:03.872457 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5a0f2a87-a79b-43f8-81e6-3f80a2b91135 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:03.873344 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5a0f2a87-a79b-43f8-81e6-3f80a2b91135 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:03.873811 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5a0f2a87-a79b-43f8-81e6-3f80a2b91135 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:04.166861 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-5a0f2a87-a79b-43f8-81e6-3f80a2b91135 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:04.177224 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5a0f2a87-a79b-43f8-81e6-3f80a2b91135 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1574 microversion: 2.1 time: 0.327665 Jan 15 02:46:04.177825 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 347/719] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:03 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1574 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:46:04.240507 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7a289ce9-f43b-4afe-9adb-b363edae6a2d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:04.241629 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-7a289ce9-f43b-4afe-9adb-b363edae6a2d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:04.254275 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7a289ce9-f43b-4afe-9adb-b363edae6a2d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:04.254797 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7a289ce9-f43b-4afe-9adb-b363edae6a2d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:04.255668 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7a289ce9-f43b-4afe-9adb-b363edae6a2d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:04.256164 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7a289ce9-f43b-4afe-9adb-b363edae6a2d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:04.387354 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-7a289ce9-f43b-4afe-9adb-b363edae6a2d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 14 microversion: 2.1 time: 0.156964 Jan 15 02:46:04.391921 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 373/720] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:04 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:46:04.756248 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-92c84745-2b3f-4d8b-995e-8f005721773c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:04.757134 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-92c84745-2b3f-4d8b-995e-8f005721773c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:04.769532 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-92c84745-2b3f-4d8b-995e-8f005721773c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:04.770320 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-92c84745-2b3f-4d8b-995e-8f005721773c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:04.771604 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-92c84745-2b3f-4d8b-995e-8f005721773c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:04.772370 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-92c84745-2b3f-4d8b-995e-8f005721773c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:05.078782 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-92c84745-2b3f-4d8b-995e-8f005721773c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:05.098772 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-92c84745-2b3f-4d8b-995e-8f005721773c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:05.106118 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-92c84745-2b3f-4d8b-995e-8f005721773c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:05.107629 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-92c84745-2b3f-4d8b-995e-8f005721773c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1741 microversion: 2.20 time: 0.368699 Jan 15 02:46:05.108323 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 348/721] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:04 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1741 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:46:05.204014 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-43adc6cd-ba71-451c-8ae0-9b0cf759f12a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:05.216614 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-43adc6cd-ba71-451c-8ae0-9b0cf759f12a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:05.226334 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-43adc6cd-ba71-451c-8ae0-9b0cf759f12a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:05.226995 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-43adc6cd-ba71-451c-8ae0-9b0cf759f12a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:05.228169 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-43adc6cd-ba71-451c-8ae0-9b0cf759f12a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:05.228811 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-43adc6cd-ba71-451c-8ae0-9b0cf759f12a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:05.413924 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4a5d126a-ef64-48f2-89d7-aed02d75b78f tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:05.415382 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4a5d126a-ef64-48f2-89d7-aed02d75b78f tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:05.429642 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4a5d126a-ef64-48f2-89d7-aed02d75b78f tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:05.430492 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4a5d126a-ef64-48f2-89d7-aed02d75b78f tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:05.431540 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4a5d126a-ef64-48f2-89d7-aed02d75b78f tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:05.432218 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4a5d126a-ef64-48f2-89d7-aed02d75b78f tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:05.596798 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4a5d126a-ef64-48f2-89d7-aed02d75b78f tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 14 microversion: 2.1 time: 0.200668 Jan 15 02:46:05.598107 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 349/722] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:05 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 14 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:46:05.655435 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-43adc6cd-ba71-451c-8ae0-9b0cf759f12a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:05.670344 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-43adc6cd-ba71-451c-8ae0-9b0cf759f12a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1574 microversion: 2.1 time: 0.477422 Jan 15 02:46:05.671465 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 374/723] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:05 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1574 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:46:06.135482 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b8fa4618-70f5-4e95-8bbd-71e3928ee32c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:06.136738 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b8fa4618-70f5-4e95-8bbd-71e3928ee32c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:06.146611 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b8fa4618-70f5-4e95-8bbd-71e3928ee32c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:06.147454 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b8fa4618-70f5-4e95-8bbd-71e3928ee32c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:06.148783 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b8fa4618-70f5-4e95-8bbd-71e3928ee32c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:06.149285 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b8fa4618-70f5-4e95-8bbd-71e3928ee32c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:06.477216 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b8fa4618-70f5-4e95-8bbd-71e3928ee32c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:06.493090 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b8fa4618-70f5-4e95-8bbd-71e3928ee32c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:06.500845 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b8fa4618-70f5-4e95-8bbd-71e3928ee32c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:06.517301 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b8fa4618-70f5-4e95-8bbd-71e3928ee32c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1741 microversion: 2.20 time: 0.378155 Jan 15 02:46:06.517698 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 350/724] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:06 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1741 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:46:06.613923 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-928a397e-6193-4201-81c4-45786a267aab tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:06.618136 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-928a397e-6193-4201-81c4-45786a267aab tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:06.647459 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-928a397e-6193-4201-81c4-45786a267aab tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:06.655510 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-928a397e-6193-4201-81c4-45786a267aab tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:06.659949 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-928a397e-6193-4201-81c4-45786a267aab tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:06.662869 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-928a397e-6193-4201-81c4-45786a267aab tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:06.701577 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-cec70cc7-beb8-45c9-a3b0-f38819e6abbc tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:06.702176 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-cec70cc7-beb8-45c9-a3b0-f38819e6abbc tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:06.722982 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cec70cc7-beb8-45c9-a3b0-f38819e6abbc tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:06.723504 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cec70cc7-beb8-45c9-a3b0-f38819e6abbc tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:06.730589 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cec70cc7-beb8-45c9-a3b0-f38819e6abbc tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:06.730589 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cec70cc7-beb8-45c9-a3b0-f38819e6abbc tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:06.851515 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-928a397e-6193-4201-81c4-45786a267aab tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 14 microversion: 2.1 time: 0.246946 Jan 15 02:46:06.855083 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 375/725] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:06 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 14 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:46:07.116877 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-cec70cc7-beb8-45c9-a3b0-f38819e6abbc tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:07.128698 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-cec70cc7-beb8-45c9-a3b0-f38819e6abbc tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1574 microversion: 2.1 time: 0.443452 Jan 15 02:46:07.129348 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 351/726] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:06 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1574 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:46:07.553159 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-94d20f3b-f0a5-4bbe-b7e7-15075637e257 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:07.554344 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-94d20f3b-f0a5-4bbe-b7e7-15075637e257 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:07.563275 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-94d20f3b-f0a5-4bbe-b7e7-15075637e257 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:07.563783 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-94d20f3b-f0a5-4bbe-b7e7-15075637e257 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:07.564649 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-94d20f3b-f0a5-4bbe-b7e7-15075637e257 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:07.566372 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-94d20f3b-f0a5-4bbe-b7e7-15075637e257 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:07.871093 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3918c2de-8c08-45ec-b7ec-aace312d8435 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:07.872136 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3918c2de-8c08-45ec-b7ec-aace312d8435 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:07.886719 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3918c2de-8c08-45ec-b7ec-aace312d8435 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:07.887240 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3918c2de-8c08-45ec-b7ec-aace312d8435 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:07.888109 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3918c2de-8c08-45ec-b7ec-aace312d8435 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:07.888602 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3918c2de-8c08-45ec-b7ec-aace312d8435 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:07.967200 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-94d20f3b-f0a5-4bbe-b7e7-15075637e257 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:07.985580 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-94d20f3b-f0a5-4bbe-b7e7-15075637e257 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:07.993551 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-94d20f3b-f0a5-4bbe-b7e7-15075637e257 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:07.995379 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-94d20f3b-f0a5-4bbe-b7e7-15075637e257 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1741 microversion: 2.20 time: 0.460098 Jan 15 02:46:07.996167 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 376/727] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:07 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1741 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:46:08.104591 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3918c2de-8c08-45ec-b7ec-aace312d8435 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 14 microversion: 2.1 time: 0.244720 Jan 15 02:46:08.106269 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 352/728] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:07 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 14 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:46:08.157471 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2e3c36e5-7fc6-4ad0-a9bd-47cea4ec7b63 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:08.157859 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2e3c36e5-7fc6-4ad0-a9bd-47cea4ec7b63 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:08.193320 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2e3c36e5-7fc6-4ad0-a9bd-47cea4ec7b63 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:08.193834 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2e3c36e5-7fc6-4ad0-a9bd-47cea4ec7b63 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:08.194739 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2e3c36e5-7fc6-4ad0-a9bd-47cea4ec7b63 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:08.195227 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2e3c36e5-7fc6-4ad0-a9bd-47cea4ec7b63 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:08.486253 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-2e3c36e5-7fc6-4ad0-a9bd-47cea4ec7b63 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:08.500697 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2e3c36e5-7fc6-4ad0-a9bd-47cea4ec7b63 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1574 microversion: 2.1 time: 0.357376 Jan 15 02:46:08.501802 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 377/729] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:08 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1574 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:46:09.033177 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-25b14f24-4efc-44c0-aca3-cc2074903412 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:09.035011 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-25b14f24-4efc-44c0-aca3-cc2074903412 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:09.044549 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-25b14f24-4efc-44c0-aca3-cc2074903412 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:09.045062 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-25b14f24-4efc-44c0-aca3-cc2074903412 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:09.046084 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-25b14f24-4efc-44c0-aca3-cc2074903412 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:09.046733 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-25b14f24-4efc-44c0-aca3-cc2074903412 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:09.124118 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4c72bbdd-93ca-4788-9a7a-1cbe4ac43209 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:09.129332 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4c72bbdd-93ca-4788-9a7a-1cbe4ac43209 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:09.138379 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4c72bbdd-93ca-4788-9a7a-1cbe4ac43209 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:09.139109 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4c72bbdd-93ca-4788-9a7a-1cbe4ac43209 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:09.140153 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4c72bbdd-93ca-4788-9a7a-1cbe4ac43209 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:09.140788 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4c72bbdd-93ca-4788-9a7a-1cbe4ac43209 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:09.304701 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4c72bbdd-93ca-4788-9a7a-1cbe4ac43209 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 11454 microversion: 2.1 time: 0.192205 Jan 15 02:46:09.306126 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 378/730] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:09 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 11454 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:46:09.517854 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-25b14f24-4efc-44c0-aca3-cc2074903412 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:09.531434 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f2e1bfc6-c973-4991-9b04-8809d5b16d5e tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:09.532836 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f2e1bfc6-c973-4991-9b04-8809d5b16d5e tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:09.543455 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-25b14f24-4efc-44c0-aca3-cc2074903412 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:09.545315 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f2e1bfc6-c973-4991-9b04-8809d5b16d5e tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:09.546230 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f2e1bfc6-c973-4991-9b04-8809d5b16d5e tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:09.547255 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f2e1bfc6-c973-4991-9b04-8809d5b16d5e tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:09.548527 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f2e1bfc6-c973-4991-9b04-8809d5b16d5e tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:09.560582 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-25b14f24-4efc-44c0-aca3-cc2074903412 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:09.576672 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-25b14f24-4efc-44c0-aca3-cc2074903412 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1741 microversion: 2.20 time: 0.554037 Jan 15 02:46:09.577954 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 353/731] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:09 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1741 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:46:09.894384 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f2e1bfc6-c973-4991-9b04-8809d5b16d5e tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:09.907428 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f2e1bfc6-c973-4991-9b04-8809d5b16d5e tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1574 microversion: 2.1 time: 0.390853 Jan 15 02:46:09.908285 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 379/732] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:09 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1574 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:46:10.322986 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-649bee33-f41f-4a0b-8d06-cfa0917cb64e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:10.324590 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-649bee33-f41f-4a0b-8d06-cfa0917cb64e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:10.335242 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-649bee33-f41f-4a0b-8d06-cfa0917cb64e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:10.335749 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-649bee33-f41f-4a0b-8d06-cfa0917cb64e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:10.336593 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-649bee33-f41f-4a0b-8d06-cfa0917cb64e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:10.337102 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-649bee33-f41f-4a0b-8d06-cfa0917cb64e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:10.482701 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-649bee33-f41f-4a0b-8d06-cfa0917cb64e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 17401 microversion: 2.1 time: 0.169973 Jan 15 02:46:10.483585 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 354/733] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:10 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 17401 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:46:10.604380 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b356731d-0fd0-4d1d-bcb8-f8ff88b9f11d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:10.605377 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b356731d-0fd0-4d1d-bcb8-f8ff88b9f11d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:10.614673 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b356731d-0fd0-4d1d-bcb8-f8ff88b9f11d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:10.615423 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b356731d-0fd0-4d1d-bcb8-f8ff88b9f11d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:10.616437 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b356731d-0fd0-4d1d-bcb8-f8ff88b9f11d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:10.617405 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b356731d-0fd0-4d1d-bcb8-f8ff88b9f11d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:10.934310 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-28080728-904d-4137-b713-7dfaf593e07c tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:10.935047 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-28080728-904d-4137-b713-7dfaf593e07c tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:10.945388 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-28080728-904d-4137-b713-7dfaf593e07c tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:10.945913 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-28080728-904d-4137-b713-7dfaf593e07c tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:10.946766 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-28080728-904d-4137-b713-7dfaf593e07c tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:10.947264 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-28080728-904d-4137-b713-7dfaf593e07c tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:10.994406 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b356731d-0fd0-4d1d-bcb8-f8ff88b9f11d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:11.019353 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b356731d-0fd0-4d1d-bcb8-f8ff88b9f11d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:11.028399 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b356731d-0fd0-4d1d-bcb8-f8ff88b9f11d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:11.029823 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b356731d-0fd0-4d1d-bcb8-f8ff88b9f11d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1741 microversion: 2.20 time: 0.436615 Jan 15 02:46:11.030420 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 380/734] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:10 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1741 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:46:11.262435 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-28080728-904d-4137-b713-7dfaf593e07c tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:11.275351 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-28080728-904d-4137-b713-7dfaf593e07c tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1574 microversion: 2.1 time: 0.351967 Jan 15 02:46:11.276289 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 355/735] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:10 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1574 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:46:11.504125 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-463ec208-fc03-45f1-9b32-fcbf6364a85b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:11.505315 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-463ec208-fc03-45f1-9b32-fcbf6364a85b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:11.513493 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-463ec208-fc03-45f1-9b32-fcbf6364a85b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:11.514014 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-463ec208-fc03-45f1-9b32-fcbf6364a85b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:11.514860 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-463ec208-fc03-45f1-9b32-fcbf6364a85b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:11.515358 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-463ec208-fc03-45f1-9b32-fcbf6364a85b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:11.682107 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-463ec208-fc03-45f1-9b32-fcbf6364a85b tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 18155 microversion: 2.1 time: 0.190156 Jan 15 02:46:11.683259 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 381/736] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:11 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 18155 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:46:12.056138 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9a5b5f40-803b-4381-b3ec-76628a39e586 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:12.057201 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9a5b5f40-803b-4381-b3ec-76628a39e586 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:12.066409 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9a5b5f40-803b-4381-b3ec-76628a39e586 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:12.067257 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9a5b5f40-803b-4381-b3ec-76628a39e586 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:12.068173 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9a5b5f40-803b-4381-b3ec-76628a39e586 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:12.068720 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9a5b5f40-803b-4381-b3ec-76628a39e586 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:12.316505 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d33b1a24-19bb-409b-bf69-3ebcb06d5186 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:12.325412 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d33b1a24-19bb-409b-bf69-3ebcb06d5186 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:12.344000 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d33b1a24-19bb-409b-bf69-3ebcb06d5186 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:12.352675 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d33b1a24-19bb-409b-bf69-3ebcb06d5186 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:12.353942 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d33b1a24-19bb-409b-bf69-3ebcb06d5186 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:12.357903 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d33b1a24-19bb-409b-bf69-3ebcb06d5186 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:12.547442 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-9a5b5f40-803b-4381-b3ec-76628a39e586 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:12.577795 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-9a5b5f40-803b-4381-b3ec-76628a39e586 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:12.613176 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-9a5b5f40-803b-4381-b3ec-76628a39e586 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:12.615705 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9a5b5f40-803b-4381-b3ec-76628a39e586 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1741 microversion: 2.20 time: 0.569439 Jan 15 02:46:12.618849 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 356/737] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:12 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1741 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:46:12.644419 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-a80ef758-f22b-4b83-b773-07a0a9930712 req-b6a47761-38a0-4f4c-b4ef-0e6d94570680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d658a3-85b8-4130-b672-9843892a6fa5", "name": "network-vif-unplugged", "status": "completed", "tag": "f6b12a20-2846-4e92-bcbd-958c13c5e899"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:12.660183 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:46:12.660183 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:46:12.670378 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-a80ef758-f22b-4b83-b773-07a0a9930712 req-b6a47761-38a0-4f4c-b4ef-0e6d94570680 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:12.671453 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-a80ef758-f22b-4b83-b773-07a0a9930712 req-b6a47761-38a0-4f4c-b4ef-0e6d94570680 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:12.692772 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-a80ef758-f22b-4b83-b773-07a0a9930712 req-b6a47761-38a0-4f4c-b4ef-0e6d94570680 service nova] Creating event network-vif-unplugged:f6b12a20-2846-4e92-bcbd-958c13c5e899 for instance 19d658a3-85b8-4130-b672-9843892a6fa5 on hv-cinder-76330 Jan 15 02:46:12.698338 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-a80ef758-f22b-4b83-b773-07a0a9930712 req-b6a47761-38a0-4f4c-b4ef-0e6d94570680 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077064 Jan 15 02:46:12.699425 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 357/738] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:46:12 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:46:12.711458 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e5717366-16fe-4433-aee6-7556d357ec20 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:12.712969 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e5717366-16fe-4433-aee6-7556d357ec20 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:12.721985 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e5717366-16fe-4433-aee6-7556d357ec20 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:12.722860 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e5717366-16fe-4433-aee6-7556d357ec20 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:12.723926 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e5717366-16fe-4433-aee6-7556d357ec20 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:12.724610 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e5717366-16fe-4433-aee6-7556d357ec20 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:12.962222 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d33b1a24-19bb-409b-bf69-3ebcb06d5186 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:12.969300 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e5717366-16fe-4433-aee6-7556d357ec20 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 20991 microversion: 2.1 time: 0.268038 Jan 15 02:46:12.970153 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 358/739] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:12 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 20991 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:46:12.982477 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d33b1a24-19bb-409b-bf69-3ebcb06d5186 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1574 microversion: 2.1 time: 0.690416 Jan 15 02:46:12.983485 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 382/740] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:12 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1574 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:46:13.650170 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-44314c57-220f-4475-902f-2087be035fc6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:13.652906 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-44314c57-220f-4475-902f-2087be035fc6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:13.663744 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-44314c57-220f-4475-902f-2087be035fc6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:13.664573 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-44314c57-220f-4475-902f-2087be035fc6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:13.665943 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-44314c57-220f-4475-902f-2087be035fc6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:13.666672 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-44314c57-220f-4475-902f-2087be035fc6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:13.988016 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ac34fe8b-e681-46b4-b9a5-517b43557934 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:13.989834 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ac34fe8b-e681-46b4-b9a5-517b43557934 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:14.016277 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ac34fe8b-e681-46b4-b9a5-517b43557934 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:14.018637 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ac34fe8b-e681-46b4-b9a5-517b43557934 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:14.019574 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ac34fe8b-e681-46b4-b9a5-517b43557934 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:14.020084 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ac34fe8b-e681-46b4-b9a5-517b43557934 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:14.127757 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-44314c57-220f-4475-902f-2087be035fc6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:14.166498 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-44314c57-220f-4475-902f-2087be035fc6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:14.182363 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-44314c57-220f-4475-902f-2087be035fc6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:14.184855 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-44314c57-220f-4475-902f-2087be035fc6 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1741 microversion: 2.20 time: 0.547562 Jan 15 02:46:14.197035 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 359/741] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:13 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1741 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:46:14.210255 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-168082bd-1799-440a-bab9-212d177a2a46 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:14.211855 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-168082bd-1799-440a-bab9-212d177a2a46 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:14.221314 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ac34fe8b-e681-46b4-b9a5-517b43557934 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 22975 microversion: 2.1 time: 0.242560 Jan 15 02:46:14.225109 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 383/742] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:13 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 22975 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 02:46:14.228420 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-168082bd-1799-440a-bab9-212d177a2a46 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:14.229330 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-168082bd-1799-440a-bab9-212d177a2a46 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:14.230921 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-168082bd-1799-440a-bab9-212d177a2a46 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:14.231826 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-168082bd-1799-440a-bab9-212d177a2a46 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:14.562884 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-168082bd-1799-440a-bab9-212d177a2a46 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:14.589153 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-168082bd-1799-440a-bab9-212d177a2a46 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1515 microversion: 2.1 time: 0.401625 Jan 15 02:46:14.603290 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 360/743] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:14 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1515 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:46:14.621642 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-63c19068-2eaf-4b1e-ad02-0d49b7915529 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:14.653236 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-63c19068-2eaf-4b1e-ad02-0d49b7915529 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:14.667625 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-63c19068-2eaf-4b1e-ad02-0d49b7915529 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:14.668145 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-63c19068-2eaf-4b1e-ad02-0d49b7915529 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:14.669059 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-63c19068-2eaf-4b1e-ad02-0d49b7915529 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:14.673637 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-63c19068-2eaf-4b1e-ad02-0d49b7915529 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:14.962338 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-63c19068-2eaf-4b1e-ad02-0d49b7915529 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "POST /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5/action" status: 202 len: 0 microversion: 2.1 time: 0.354569 Jan 15 02:46:14.963188 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 384/744] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:14 2021] POST /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:46:14.980168 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-50b63ea5-f9de-4bc5-9a15-c1d2aae7d8cb tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:14.980841 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-50b63ea5-f9de-4bc5-9a15-c1d2aae7d8cb tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:15.002817 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-50b63ea5-f9de-4bc5-9a15-c1d2aae7d8cb tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:15.003301 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-50b63ea5-f9de-4bc5-9a15-c1d2aae7d8cb tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:15.004368 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-50b63ea5-f9de-4bc5-9a15-c1d2aae7d8cb tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:15.004854 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-50b63ea5-f9de-4bc5-9a15-c1d2aae7d8cb tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:15.222234 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-dacc36e4-6338-4438-80f9-77dfc4b11e16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:15.226569 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-dacc36e4-6338-4438-80f9-77dfc4b11e16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:15.247535 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dacc36e4-6338-4438-80f9-77dfc4b11e16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:15.250308 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dacc36e4-6338-4438-80f9-77dfc4b11e16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:15.251834 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dacc36e4-6338-4438-80f9-77dfc4b11e16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:15.254828 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dacc36e4-6338-4438-80f9-77dfc4b11e16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:15.334221 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-50b63ea5-f9de-4bc5-9a15-c1d2aae7d8cb tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:15.344560 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-50b63ea5-f9de-4bc5-9a15-c1d2aae7d8cb tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1523 microversion: 2.1 time: 0.376861 Jan 15 02:46:15.345443 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 361/745] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:14 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1523 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:46:15.358133 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-dc0fb2c1-c2dc-4e2a-ba38-182c7f33f02d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:15.359942 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-dc0fb2c1-c2dc-4e2a-ba38-182c7f33f02d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:15.369713 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dc0fb2c1-c2dc-4e2a-ba38-182c7f33f02d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:15.370477 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dc0fb2c1-c2dc-4e2a-ba38-182c7f33f02d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:15.371341 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dc0fb2c1-c2dc-4e2a-ba38-182c7f33f02d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:15.371853 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dc0fb2c1-c2dc-4e2a-ba38-182c7f33f02d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:15.614886 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-dacc36e4-6338-4438-80f9-77dfc4b11e16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:15.630563 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-dacc36e4-6338-4438-80f9-77dfc4b11e16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:15.637984 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-dacc36e4-6338-4438-80f9-77dfc4b11e16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:15.639558 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-dacc36e4-6338-4438-80f9-77dfc4b11e16 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1741 microversion: 2.20 time: 0.435722 Jan 15 02:46:15.640141 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 385/746] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:15 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1741 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:46:15.695960 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-dc0fb2c1-c2dc-4e2a-ba38-182c7f33f02d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 24680 microversion: 2.1 time: 0.348078 Jan 15 02:46:15.696696 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 362/747] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:15 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 24680 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:46:16.370586 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a58fd83a-f7c3-485c-8fb6-80b39121973b tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:16.371654 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a58fd83a-f7c3-485c-8fb6-80b39121973b tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:16.383139 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a58fd83a-f7c3-485c-8fb6-80b39121973b tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:16.385024 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a58fd83a-f7c3-485c-8fb6-80b39121973b tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:16.385024 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a58fd83a-f7c3-485c-8fb6-80b39121973b tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:16.385226 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a58fd83a-f7c3-485c-8fb6-80b39121973b tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:16.667989 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6b268ae0-7b6f-406a-96fe-874d8347b526 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:16.668788 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6b268ae0-7b6f-406a-96fe-874d8347b526 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:16.711367 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a58fd83a-f7c3-485c-8fb6-80b39121973b tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:16.713931 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6b268ae0-7b6f-406a-96fe-874d8347b526 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:16.716636 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6b268ae0-7b6f-406a-96fe-874d8347b526 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:16.717875 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6b268ae0-7b6f-406a-96fe-874d8347b526 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:16.718820 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6b268ae0-7b6f-406a-96fe-874d8347b526 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:16.723397 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a58fd83a-f7c3-485c-8fb6-80b39121973b tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1525 microversion: 2.1 time: 0.363375 Jan 15 02:46:16.724456 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 386/748] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:16 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1525 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:46:16.746675 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9addccb2-0fdd-492d-a258-5c10e6000dd6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:16.747737 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9addccb2-0fdd-492d-a258-5c10e6000dd6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:16.756868 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9addccb2-0fdd-492d-a258-5c10e6000dd6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:16.757413 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9addccb2-0fdd-492d-a258-5c10e6000dd6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:16.758284 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9addccb2-0fdd-492d-a258-5c10e6000dd6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:16.758783 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9addccb2-0fdd-492d-a258-5c10e6000dd6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:16.905266 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9addccb2-0fdd-492d-a258-5c10e6000dd6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 26321 microversion: 2.1 time: 0.168494 Jan 15 02:46:16.906721 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 387/749] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:16 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 26321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:46:17.123604 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6b268ae0-7b6f-406a-96fe-874d8347b526 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:17.142427 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6b268ae0-7b6f-406a-96fe-874d8347b526 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:17.150147 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6b268ae0-7b6f-406a-96fe-874d8347b526 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:17.151415 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6b268ae0-7b6f-406a-96fe-874d8347b526 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1723 microversion: 2.20 time: 0.494254 Jan 15 02:46:17.152018 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 363/750] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:16 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1723 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:46:17.767902 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-dcd6fde6-f659-49e4-a23a-5d8c8af71d4a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:17.769688 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-dcd6fde6-f659-49e4-a23a-5d8c8af71d4a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:17.787797 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dcd6fde6-f659-49e4-a23a-5d8c8af71d4a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:17.789278 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dcd6fde6-f659-49e4-a23a-5d8c8af71d4a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:17.791198 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dcd6fde6-f659-49e4-a23a-5d8c8af71d4a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:17.792453 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dcd6fde6-f659-49e4-a23a-5d8c8af71d4a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:17.923914 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3b4f5cec-d4a2-496d-8b29-3d2c1d2dc2f0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:17.925264 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3b4f5cec-d4a2-496d-8b29-3d2c1d2dc2f0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:17.934900 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3b4f5cec-d4a2-496d-8b29-3d2c1d2dc2f0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:17.935524 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3b4f5cec-d4a2-496d-8b29-3d2c1d2dc2f0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:17.936473 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3b4f5cec-d4a2-496d-8b29-3d2c1d2dc2f0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:17.937068 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3b4f5cec-d4a2-496d-8b29-3d2c1d2dc2f0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:18.094492 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3b4f5cec-d4a2-496d-8b29-3d2c1d2dc2f0 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 27218 microversion: 2.1 time: 0.179962 Jan 15 02:46:18.095218 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 364/751] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:17 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 27218 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 02:46:18.164116 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-dcd6fde6-f659-49e4-a23a-5d8c8af71d4a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:18.176656 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-dcd6fde6-f659-49e4-a23a-5d8c8af71d4a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1525 microversion: 2.1 time: 0.434638 Jan 15 02:46:18.177579 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 388/752] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:17 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1525 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:46:18.179081 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-aeb69a50-efae-4e0f-b65b-84ede35f1b04 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:18.180119 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-aeb69a50-efae-4e0f-b65b-84ede35f1b04 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:18.190114 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-aeb69a50-efae-4e0f-b65b-84ede35f1b04 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:18.190992 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-aeb69a50-efae-4e0f-b65b-84ede35f1b04 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:18.191876 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-aeb69a50-efae-4e0f-b65b-84ede35f1b04 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:18.192376 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-aeb69a50-efae-4e0f-b65b-84ede35f1b04 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:18.664135 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-aeb69a50-efae-4e0f-b65b-84ede35f1b04 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:18.679618 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-aeb69a50-efae-4e0f-b65b-84ede35f1b04 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:18.686299 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-aeb69a50-efae-4e0f-b65b-84ede35f1b04 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:18.687518 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-aeb69a50-efae-4e0f-b65b-84ede35f1b04 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1723 microversion: 2.20 time: 0.519940 Jan 15 02:46:18.688170 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 365/753] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:18 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1723 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:46:19.113940 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d2a74d5f-216b-4628-8b08-4855b5133c79 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:19.115012 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d2a74d5f-216b-4628-8b08-4855b5133c79 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:19.124190 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d2a74d5f-216b-4628-8b08-4855b5133c79 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:19.124991 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d2a74d5f-216b-4628-8b08-4855b5133c79 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:19.125602 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d2a74d5f-216b-4628-8b08-4855b5133c79 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:19.126094 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d2a74d5f-216b-4628-8b08-4855b5133c79 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:19.201553 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-8f50e6da-d0dd-488b-9409-d5d6dbf54571 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:19.203089 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8f50e6da-d0dd-488b-9409-d5d6dbf54571 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:19.211395 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8f50e6da-d0dd-488b-9409-d5d6dbf54571 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:19.211878 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8f50e6da-d0dd-488b-9409-d5d6dbf54571 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:19.212973 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8f50e6da-d0dd-488b-9409-d5d6dbf54571 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:19.213496 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8f50e6da-d0dd-488b-9409-d5d6dbf54571 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:19.278686 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d2a74d5f-216b-4628-8b08-4855b5133c79 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 27606 microversion: 2.1 time: 0.174936 Jan 15 02:46:19.279999 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 389/754] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:19 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 27606 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:46:19.468625 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-8f50e6da-d0dd-488b-9409-d5d6dbf54571 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:19.479358 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-8f50e6da-d0dd-488b-9409-d5d6dbf54571 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1581 microversion: 2.1 time: 0.286819 Jan 15 02:46:19.479984 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 366/755] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:19 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1581 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:46:19.715424 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-bfb6c595-608d-40c0-bd15-0a30386069bf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:19.716207 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-bfb6c595-608d-40c0-bd15-0a30386069bf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:19.725934 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bfb6c595-608d-40c0-bd15-0a30386069bf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:19.726443 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bfb6c595-608d-40c0-bd15-0a30386069bf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:19.727309 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bfb6c595-608d-40c0-bd15-0a30386069bf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:19.727807 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bfb6c595-608d-40c0-bd15-0a30386069bf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:19.985657 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-bfb6c595-608d-40c0-bd15-0a30386069bf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:20.001545 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-bfb6c595-608d-40c0-bd15-0a30386069bf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:20.008448 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-bfb6c595-608d-40c0-bd15-0a30386069bf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:20.009721 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-bfb6c595-608d-40c0-bd15-0a30386069bf tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1666 microversion: 2.20 time: 0.305507 Jan 15 02:46:20.010328 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 390/756] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:19 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1666 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:46:20.035631 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-376505b2-b821-456a-ab4e-025c0a33bb0c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8bcf227c-175d-415d-b2af-2c55a1464f07"}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:20.036830 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-376505b2-b821-456a-ab4e-025c0a33bb0c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:20.045021 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-376505b2-b821-456a-ab4e-025c0a33bb0c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:20.045565 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-376505b2-b821-456a-ab4e-025c0a33bb0c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:20.046421 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-376505b2-b821-456a-ab4e-025c0a33bb0c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:20.046918 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-376505b2-b821-456a-ab4e-025c0a33bb0c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:20.299192 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-61efaa32-29f5-47d5-8827-ee4685609c48 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:20.300972 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-61efaa32-29f5-47d5-8827-ee4685609c48 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:20.310048 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-61efaa32-29f5-47d5-8827-ee4685609c48 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:20.310564 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-61efaa32-29f5-47d5-8827-ee4685609c48 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:20.311417 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-61efaa32-29f5-47d5-8827-ee4685609c48 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:20.311906 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-61efaa32-29f5-47d5-8827-ee4685609c48 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:20.463859 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-61efaa32-29f5-47d5-8827-ee4685609c48 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 28095 microversion: 2.1 time: 0.175085 Jan 15 02:46:20.464567 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 391/757] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:20 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 28095 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 02:46:20.477444 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-d5e19009-4059-4f83-b65a-05d5705acce5 req-82a70851-083a-4204-9da7-baeebdaad0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "813b0cda-aa4a-4e8d-a4c7-2042b9415e81", "name": "network-vif-unplugged", "status": "completed", "tag": "6e4e5bd0-fe30-49a1-b6cb-89dcd970bde9"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:20.484264 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:46:20.484264 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:46:20.495609 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-d5e19009-4059-4f83-b65a-05d5705acce5 req-82a70851-083a-4204-9da7-baeebdaad0d3 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:20.496041 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-d5e19009-4059-4f83-b65a-05d5705acce5 req-82a70851-083a-4204-9da7-baeebdaad0d3 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:20.516012 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.compute.server_external_events [req-d5e19009-4059-4f83-b65a-05d5705acce5 req-82a70851-083a-4204-9da7-baeebdaad0d3 service nova] Unable to find a host for instance 813b0cda-aa4a-4e8d-a4c7-2042b9415e81. Dropping event network-vif-unplugged {{(pid=94111) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Jan 15 02:46:20.517135 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-d5e19009-4059-4f83-b65a-05d5705acce5 req-82a70851-083a-4204-9da7-baeebdaad0d3 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.051087 Jan 15 02:46:20.519026 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 392/758] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:46:20 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 53 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 15 02:46:20.530005 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-78177b14-7410-45e7-a093-46b6ad516575 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:20.530815 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-78177b14-7410-45e7-a093-46b6ad516575 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:20.541709 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-78177b14-7410-45e7-a093-46b6ad516575 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:20.542674 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-78177b14-7410-45e7-a093-46b6ad516575 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:20.543607 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-78177b14-7410-45e7-a093-46b6ad516575 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:20.544207 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-78177b14-7410-45e7-a093-46b6ad516575 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:20.569712 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-376505b2-b821-456a-ab4e-025c0a33bb0c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.543997 Jan 15 02:46:20.570710 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 367/759] 10.222.0.37 () {62 vars in 1354 bytes} [Fri Jan 15 02:46:20 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/os-volume_attachments => generated 188 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:46:20.737663 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b84e71f2-0ef9-44c2-9e21-c529faf0e57e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:20.738209 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b84e71f2-0ef9-44c2-9e21-c529faf0e57e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:20.747087 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b84e71f2-0ef9-44c2-9e21-c529faf0e57e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:20.747476 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b84e71f2-0ef9-44c2-9e21-c529faf0e57e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:20.748324 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b84e71f2-0ef9-44c2-9e21-c529faf0e57e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:20.748821 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b84e71f2-0ef9-44c2-9e21-c529faf0e57e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:20.869321 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-78177b14-7410-45e7-a093-46b6ad516575 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:20.879155 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-78177b14-7410-45e7-a093-46b6ad516575 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1581 microversion: 2.1 time: 0.359668 Jan 15 02:46:20.879996 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 393/760] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:20 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1581 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:46:21.293485 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b84e71f2-0ef9-44c2-9e21-c529faf0e57e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "DELETE /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/os-volume_attachments/8bcf227c-175d-415d-b2af-2c55a1464f07" status: 202 len: 0 microversion: 2.20 time: 0.565977 Jan 15 02:46:21.294153 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 368/761] 10.222.0.37 () {60 vars in 1447 bytes} [Fri Jan 15 02:46:20 2021] DELETE /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/os-volume_attachments/8bcf227c-175d-415d-b2af-2c55a1464f07 => generated 0 bytes in 568 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 15 02:46:21.412666 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-beab64f0-da7c-419f-a490-a49d5c59bef4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:21.413358 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-beab64f0-da7c-419f-a490-a49d5c59bef4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:21.421432 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-beab64f0-da7c-419f-a490-a49d5c59bef4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:21.421942 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-beab64f0-da7c-419f-a490-a49d5c59bef4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:21.422800 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-beab64f0-da7c-419f-a490-a49d5c59bef4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:21.423286 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-beab64f0-da7c-419f-a490-a49d5c59bef4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:21.484873 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c3ae9e28-3f3f-43db-8515-644fad372dff tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:21.486142 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c3ae9e28-3f3f-43db-8515-644fad372dff tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:21.495874 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c3ae9e28-3f3f-43db-8515-644fad372dff tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:21.496409 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c3ae9e28-3f3f-43db-8515-644fad372dff tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:21.497297 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c3ae9e28-3f3f-43db-8515-644fad372dff tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:21.497790 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c3ae9e28-3f3f-43db-8515-644fad372dff tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:21.597977 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-beab64f0-da7c-419f-a490-a49d5c59bef4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action" status: 202 len: 0 microversion: 2.20 time: 0.194980 Jan 15 02:46:21.598543 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 394/762] 10.222.0.37 () {62 vars in 1309 bytes} [Fri Jan 15 02:46:21 2021] POST /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 15 02:46:21.613285 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ad777613-533e-425b-ba64-1ff0548a3bf2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:21.613969 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ad777613-533e-425b-ba64-1ff0548a3bf2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:21.623940 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ad777613-533e-425b-ba64-1ff0548a3bf2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:21.624467 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ad777613-533e-425b-ba64-1ff0548a3bf2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:21.626057 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ad777613-533e-425b-ba64-1ff0548a3bf2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:21.626742 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ad777613-533e-425b-ba64-1ff0548a3bf2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:21.646389 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c3ae9e28-3f3f-43db-8515-644fad372dff tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 28212 microversion: 2.1 time: 0.172831 Jan 15 02:46:21.647579 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 369/763] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:21 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 28212 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 02:46:21.905592 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-491c461b-edfb-4f1c-b3f0-93c724ecbea9 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:21.906449 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-491c461b-edfb-4f1c-b3f0-93c724ecbea9 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:21.916749 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-491c461b-edfb-4f1c-b3f0-93c724ecbea9 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:21.917285 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-491c461b-edfb-4f1c-b3f0-93c724ecbea9 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:21.918134 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-491c461b-edfb-4f1c-b3f0-93c724ecbea9 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:21.918627 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-491c461b-edfb-4f1c-b3f0-93c724ecbea9 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:21.931750 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-ad777613-533e-425b-ba64-1ff0548a3bf2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:21.951222 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-ad777613-533e-425b-ba64-1ff0548a3bf2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:21.968535 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-ad777613-533e-425b-ba64-1ff0548a3bf2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:21.971718 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ad777613-533e-425b-ba64-1ff0548a3bf2 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1674 microversion: 2.20 time: 0.367647 Jan 15 02:46:21.973045 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 395/764] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:21 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1674 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:46:22.231989 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-491c461b-edfb-4f1c-b3f0-93c724ecbea9 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:22.253170 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-491c461b-edfb-4f1c-b3f0-93c724ecbea9 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1581 microversion: 2.1 time: 0.356477 Jan 15 02:46:22.254312 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 370/765] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:21 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1581 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:46:22.667389 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-772440cd-ec62-4dc5-add2-b5d69808bd74 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:22.668987 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-772440cd-ec62-4dc5-add2-b5d69808bd74 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:22.678269 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-772440cd-ec62-4dc5-add2-b5d69808bd74 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:22.679203 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-772440cd-ec62-4dc5-add2-b5d69808bd74 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:22.680245 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-772440cd-ec62-4dc5-add2-b5d69808bd74 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:22.680898 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-772440cd-ec62-4dc5-add2-b5d69808bd74 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:22.841557 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-772440cd-ec62-4dc5-add2-b5d69808bd74 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 28503 microversion: 2.1 time: 0.184627 Jan 15 02:46:22.842520 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 396/766] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:22 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 28503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 02:46:23.007613 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-eb55c083-bb55-4daa-a64c-a97fb7e76103 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:23.009241 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-eb55c083-bb55-4daa-a64c-a97fb7e76103 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:23.025859 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eb55c083-bb55-4daa-a64c-a97fb7e76103 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:23.026730 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eb55c083-bb55-4daa-a64c-a97fb7e76103 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:23.028199 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eb55c083-bb55-4daa-a64c-a97fb7e76103 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:23.029034 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eb55c083-bb55-4daa-a64c-a97fb7e76103 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:23.279944 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-cf052b5f-8bc0-4a23-8bc0-041f4e89be47 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:23.281493 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-cf052b5f-8bc0-4a23-8bc0-041f4e89be47 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:23.291503 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cf052b5f-8bc0-4a23-8bc0-041f4e89be47 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:23.291759 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cf052b5f-8bc0-4a23-8bc0-041f4e89be47 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:23.292777 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cf052b5f-8bc0-4a23-8bc0-041f4e89be47 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:23.293333 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cf052b5f-8bc0-4a23-8bc0-041f4e89be47 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:23.366735 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-eb55c083-bb55-4daa-a64c-a97fb7e76103 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:23.383914 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-eb55c083-bb55-4daa-a64c-a97fb7e76103 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:23.391188 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-eb55c083-bb55-4daa-a64c-a97fb7e76103 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:23.393941 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-eb55c083-bb55-4daa-a64c-a97fb7e76103 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1676 microversion: 2.20 time: 0.400302 Jan 15 02:46:23.394872 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 371/767] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:22 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1676 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:46:23.795467 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-cf052b5f-8bc0-4a23-8bc0-041f4e89be47 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:23.806596 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-cf052b5f-8bc0-4a23-8bc0-041f4e89be47 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1581 microversion: 2.1 time: 0.537010 Jan 15 02:46:23.807202 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 397/768] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:23 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1581 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:46:23.864787 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-bba1fc52-0a6e-4f23-9306-c54735c827b6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:23.866993 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-bba1fc52-0a6e-4f23-9306-c54735c827b6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:23.876357 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bba1fc52-0a6e-4f23-9306-c54735c827b6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:23.877603 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bba1fc52-0a6e-4f23-9306-c54735c827b6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:23.878555 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bba1fc52-0a6e-4f23-9306-c54735c827b6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:23.879043 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bba1fc52-0a6e-4f23-9306-c54735c827b6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:24.038544 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-bba1fc52-0a6e-4f23-9306-c54735c827b6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 28671 microversion: 2.1 time: 0.184813 Jan 15 02:46:24.039871 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 372/769] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:23 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 28671 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:46:24.426372 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6fcd0824-e486-41fc-911d-c2547107231c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:24.427056 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6fcd0824-e486-41fc-911d-c2547107231c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:24.436165 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6fcd0824-e486-41fc-911d-c2547107231c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:24.436534 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6fcd0824-e486-41fc-911d-c2547107231c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:24.437476 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6fcd0824-e486-41fc-911d-c2547107231c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:24.437988 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6fcd0824-e486-41fc-911d-c2547107231c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:24.832717 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6bbfc1b2-b510-4181-ae21-feeaf69d5d5d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:24.833882 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6bbfc1b2-b510-4181-ae21-feeaf69d5d5d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:24.843986 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6bbfc1b2-b510-4181-ae21-feeaf69d5d5d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:24.844808 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6bbfc1b2-b510-4181-ae21-feeaf69d5d5d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:24.845808 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6bbfc1b2-b510-4181-ae21-feeaf69d5d5d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:24.846564 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6bbfc1b2-b510-4181-ae21-feeaf69d5d5d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:24.867718 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6fcd0824-e486-41fc-911d-c2547107231c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:24.891756 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6fcd0824-e486-41fc-911d-c2547107231c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:24.899922 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6fcd0824-e486-41fc-911d-c2547107231c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:24.901562 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6fcd0824-e486-41fc-911d-c2547107231c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1732 microversion: 2.20 time: 0.485658 Jan 15 02:46:24.915807 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 398/770] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:24 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1732 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:46:25.056872 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-204def21-b63c-4159-86e4-aa5387ca9598 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:25.057829 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-204def21-b63c-4159-86e4-aa5387ca9598 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:25.073770 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-204def21-b63c-4159-86e4-aa5387ca9598 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:25.074257 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-204def21-b63c-4159-86e4-aa5387ca9598 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:25.075587 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-204def21-b63c-4159-86e4-aa5387ca9598 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:25.076264 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-204def21-b63c-4159-86e4-aa5387ca9598 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:25.126411 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6bbfc1b2-b510-4181-ae21-feeaf69d5d5d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:25.137362 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6bbfc1b2-b510-4181-ae21-feeaf69d5d5d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1581 microversion: 2.1 time: 0.315183 Jan 15 02:46:25.137974 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 373/771] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:24 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1581 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:46:25.223758 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-204def21-b63c-4159-86e4-aa5387ca9598 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 28671 microversion: 2.1 time: 0.176327 Jan 15 02:46:25.226439 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 399/772] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:25 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 28671 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 02:46:25.927673 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-19d061fb-09e6-4739-9295-da8b2f5b5157 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:25.929332 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-19d061fb-09e6-4739-9295-da8b2f5b5157 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:25.942267 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-19d061fb-09e6-4739-9295-da8b2f5b5157 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:25.942771 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-19d061fb-09e6-4739-9295-da8b2f5b5157 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:25.943696 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-19d061fb-09e6-4739-9295-da8b2f5b5157 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:25.944185 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-19d061fb-09e6-4739-9295-da8b2f5b5157 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:26.167863 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d38fca6f-0c7a-468d-93d6-9dbbc611d515 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:26.168936 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d38fca6f-0c7a-468d-93d6-9dbbc611d515 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:26.186517 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d38fca6f-0c7a-468d-93d6-9dbbc611d515 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:26.190535 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d38fca6f-0c7a-468d-93d6-9dbbc611d515 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:26.192004 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d38fca6f-0c7a-468d-93d6-9dbbc611d515 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:26.192691 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d38fca6f-0c7a-468d-93d6-9dbbc611d515 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:26.265533 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-19d061fb-09e6-4739-9295-da8b2f5b5157 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:26.282927 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-19d061fb-09e6-4739-9295-da8b2f5b5157 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:26.290461 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-19d061fb-09e6-4739-9295-da8b2f5b5157 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:26.292040 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-19d061fb-09e6-4739-9295-da8b2f5b5157 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1732 microversion: 2.20 time: 0.374501 Jan 15 02:46:26.293515 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 374/773] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:25 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1732 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:46:26.307727 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f8200001-c208-4335-8759-6f155f575c8d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:26.309740 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f8200001-c208-4335-8759-6f155f575c8d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:26.322116 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f8200001-c208-4335-8759-6f155f575c8d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:26.322766 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f8200001-c208-4335-8759-6f155f575c8d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:26.323909 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f8200001-c208-4335-8759-6f155f575c8d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:26.324639 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f8200001-c208-4335-8759-6f155f575c8d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:26.582719 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d38fca6f-0c7a-468d-93d6-9dbbc611d515 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:26.592505 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d38fca6f-0c7a-468d-93d6-9dbbc611d515 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1581 microversion: 2.1 time: 0.440218 Jan 15 02:46:26.593323 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 400/774] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:26 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1581 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:46:27.186441 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-512832e9-49c5-43f0-bb6a-6756e285d997 req-f083d525-8087-4015-9ab7-0f4013522aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d658a3-85b8-4130-b672-9843892a6fa5", "name": "network-vif-plugged", "status": "completed", "tag": "f6b12a20-2846-4e92-bcbd-958c13c5e899"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:27.195219 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:46:27.195219 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:46:27.206507 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-512832e9-49c5-43f0-bb6a-6756e285d997 req-f083d525-8087-4015-9ab7-0f4013522aed service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:27.207272 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-512832e9-49c5-43f0-bb6a-6756e285d997 req-f083d525-8087-4015-9ab7-0f4013522aed service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:27.229074 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-512832e9-49c5-43f0-bb6a-6756e285d997 req-f083d525-8087-4015-9ab7-0f4013522aed service nova] Creating event network-vif-plugged:f6b12a20-2846-4e92-bcbd-958c13c5e899 for instance 19d658a3-85b8-4130-b672-9843892a6fa5 on hv-cinder-76330 Jan 15 02:46:27.237223 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-512832e9-49c5-43f0-bb6a-6756e285d997 req-f083d525-8087-4015-9ab7-0f4013522aed service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059577 Jan 15 02:46:27.238180 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 401/775] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:46:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:46:27.325292 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-444a040a-8cb5-473a-bbed-0b2a653a4a20 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:27.326467 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-444a040a-8cb5-473a-bbed-0b2a653a4a20 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:27.337320 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-444a040a-8cb5-473a-bbed-0b2a653a4a20 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:27.337842 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-444a040a-8cb5-473a-bbed-0b2a653a4a20 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:27.338742 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-444a040a-8cb5-473a-bbed-0b2a653a4a20 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:27.339303 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-444a040a-8cb5-473a-bbed-0b2a653a4a20 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:27.637246 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-444a040a-8cb5-473a-bbed-0b2a653a4a20 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:27.666112 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-444a040a-8cb5-473a-bbed-0b2a653a4a20 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:27.673389 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-444a040a-8cb5-473a-bbed-0b2a653a4a20 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:27.674997 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-444a040a-8cb5-473a-bbed-0b2a653a4a20 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1732 microversion: 2.20 time: 0.364083 Jan 15 02:46:27.686952 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 402/776] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:27 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1732 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:46:27.696484 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-763727a3-1a6f-4094-a8af-b11eeaef842d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:27.697512 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-763727a3-1a6f-4094-a8af-b11eeaef842d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:27.721964 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-763727a3-1a6f-4094-a8af-b11eeaef842d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:27.722493 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-763727a3-1a6f-4094-a8af-b11eeaef842d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:27.723387 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-763727a3-1a6f-4094-a8af-b11eeaef842d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:27.723889 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-763727a3-1a6f-4094-a8af-b11eeaef842d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:28.089684 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-763727a3-1a6f-4094-a8af-b11eeaef842d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:28.099243 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-763727a3-1a6f-4094-a8af-b11eeaef842d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1581 microversion: 2.1 time: 0.417219 Jan 15 02:46:28.100562 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 403/777] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:27 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1581 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:46:28.724851 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d1ff451d-044f-40b3-879a-025596aa3d58 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:28.727245 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d1ff451d-044f-40b3-879a-025596aa3d58 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:28.747133 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d1ff451d-044f-40b3-879a-025596aa3d58 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:28.748667 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d1ff451d-044f-40b3-879a-025596aa3d58 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:28.750781 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d1ff451d-044f-40b3-879a-025596aa3d58 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:28.752520 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d1ff451d-044f-40b3-879a-025596aa3d58 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:29.210661 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d1ff451d-044f-40b3-879a-025596aa3d58 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:29.243081 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d1ff451d-044f-40b3-879a-025596aa3d58 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:29.259818 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d1ff451d-044f-40b3-879a-025596aa3d58 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:29.261688 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d1ff451d-044f-40b3-879a-025596aa3d58 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1732 microversion: 2.20 time: 0.567025 Jan 15 02:46:29.285283 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 404/778] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:28 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1732 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:46:29.306520 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-492c9d2a-0a69-435e-9f8e-207d67ebb318 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:29.307674 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-492c9d2a-0a69-435e-9f8e-207d67ebb318 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:29.323276 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-492c9d2a-0a69-435e-9f8e-207d67ebb318 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:29.324186 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-492c9d2a-0a69-435e-9f8e-207d67ebb318 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:29.325699 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-492c9d2a-0a69-435e-9f8e-207d67ebb318 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:29.326301 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-492c9d2a-0a69-435e-9f8e-207d67ebb318 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:29.746422 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-492c9d2a-0a69-435e-9f8e-207d67ebb318 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:29.762644 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-492c9d2a-0a69-435e-9f8e-207d67ebb318 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1581 microversion: 2.1 time: 0.475090 Jan 15 02:46:29.763731 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 405/779] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:29 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1581 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:46:30.305668 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-0570ea7d-8532-4a5f-8703-88cff1ae6b36 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:30.306424 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-0570ea7d-8532-4a5f-8703-88cff1ae6b36 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:30.315657 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0570ea7d-8532-4a5f-8703-88cff1ae6b36 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:30.316174 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0570ea7d-8532-4a5f-8703-88cff1ae6b36 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:30.317149 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0570ea7d-8532-4a5f-8703-88cff1ae6b36 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:30.317696 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0570ea7d-8532-4a5f-8703-88cff1ae6b36 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:31.015482 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0570ea7d-8532-4a5f-8703-88cff1ae6b36 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:31.032128 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0570ea7d-8532-4a5f-8703-88cff1ae6b36 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:31.040259 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0570ea7d-8532-4a5f-8703-88cff1ae6b36 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:31.041576 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-0570ea7d-8532-4a5f-8703-88cff1ae6b36 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1732 microversion: 2.20 time: 0.745826 Jan 15 02:46:31.042185 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 406/780] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:30 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1732 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:46:31.057143 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-192b3aaa-b46c-468b-a746-85cff56d7ac9 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:31.058156 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-192b3aaa-b46c-468b-a746-85cff56d7ac9 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:31.068901 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-192b3aaa-b46c-468b-a746-85cff56d7ac9 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:31.069483 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-192b3aaa-b46c-468b-a746-85cff56d7ac9 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:31.071091 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-192b3aaa-b46c-468b-a746-85cff56d7ac9 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:31.071091 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-192b3aaa-b46c-468b-a746-85cff56d7ac9 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:31.472547 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-192b3aaa-b46c-468b-a746-85cff56d7ac9 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:31.492018 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-192b3aaa-b46c-468b-a746-85cff56d7ac9 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1581 microversion: 2.1 time: 0.448240 Jan 15 02:46:31.493522 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 407/781] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:31 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1581 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:46:32.074961 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5d1e24d0-a520-43d3-8f59-aa9d05e4c95d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:32.075990 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5d1e24d0-a520-43d3-8f59-aa9d05e4c95d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:32.084825 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5d1e24d0-a520-43d3-8f59-aa9d05e4c95d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:32.085707 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5d1e24d0-a520-43d3-8f59-aa9d05e4c95d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:32.086631 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5d1e24d0-a520-43d3-8f59-aa9d05e4c95d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:32.087145 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5d1e24d0-a520-43d3-8f59-aa9d05e4c95d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:32.423869 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-5d1e24d0-a520-43d3-8f59-aa9d05e4c95d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:32.440544 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-5d1e24d0-a520-43d3-8f59-aa9d05e4c95d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:32.448098 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-5d1e24d0-a520-43d3-8f59-aa9d05e4c95d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:32.449412 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5d1e24d0-a520-43d3-8f59-aa9d05e4c95d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1732 microversion: 2.20 time: 0.384276 Jan 15 02:46:32.450326 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 408/782] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:32 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1732 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:46:32.527090 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2d5386c9-a7f4-4ecd-8cab-17b1e543365a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:32.527783 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2d5386c9-a7f4-4ecd-8cab-17b1e543365a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:32.537306 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2d5386c9-a7f4-4ecd-8cab-17b1e543365a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:32.537824 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2d5386c9-a7f4-4ecd-8cab-17b1e543365a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:32.538707 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2d5386c9-a7f4-4ecd-8cab-17b1e543365a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:32.539209 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2d5386c9-a7f4-4ecd-8cab-17b1e543365a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:32.888756 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-2d5386c9-a7f4-4ecd-8cab-17b1e543365a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:32.908806 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2d5386c9-a7f4-4ecd-8cab-17b1e543365a tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1581 microversion: 2.1 time: 0.391224 Jan 15 02:46:32.910226 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 409/783] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:32 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1581 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:46:33.476081 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7b419d75-2e12-4153-b15c-7f9344809e33 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:33.477341 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-7b419d75-2e12-4153-b15c-7f9344809e33 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:33.488046 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7b419d75-2e12-4153-b15c-7f9344809e33 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:33.488559 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7b419d75-2e12-4153-b15c-7f9344809e33 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:33.490128 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7b419d75-2e12-4153-b15c-7f9344809e33 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:33.490128 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7b419d75-2e12-4153-b15c-7f9344809e33 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:33.788190 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-7b419d75-2e12-4153-b15c-7f9344809e33 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:33.808255 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-7b419d75-2e12-4153-b15c-7f9344809e33 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:33.816178 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-7b419d75-2e12-4153-b15c-7f9344809e33 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:33.818045 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-7b419d75-2e12-4153-b15c-7f9344809e33 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1732 microversion: 2.20 time: 0.352823 Jan 15 02:46:33.818675 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 410/784] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:33 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1732 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:46:33.948867 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b9ef6395-7b1b-4cce-8e7d-2c68e639ede2 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:33.950480 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b9ef6395-7b1b-4cce-8e7d-2c68e639ede2 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:33.961527 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b9ef6395-7b1b-4cce-8e7d-2c68e639ede2 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:33.962159 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b9ef6395-7b1b-4cce-8e7d-2c68e639ede2 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:33.963195 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b9ef6395-7b1b-4cce-8e7d-2c68e639ede2 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:33.963801 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b9ef6395-7b1b-4cce-8e7d-2c68e639ede2 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:34.837053 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b9ef6395-7b1b-4cce-8e7d-2c68e639ede2 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:34.854692 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b9ef6395-7b1b-4cce-8e7d-2c68e639ede2 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1581 microversion: 2.1 time: 0.916435 Jan 15 02:46:34.856748 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 411/785] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:33 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1581 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:46:34.890452 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-eea43868-30c3-4ce9-8c63-c7780be57ff5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:34.899228 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-eea43868-30c3-4ce9-8c63-c7780be57ff5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:34.930965 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eea43868-30c3-4ce9-8c63-c7780be57ff5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:34.932676 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eea43868-30c3-4ce9-8c63-c7780be57ff5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:34.935735 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eea43868-30c3-4ce9-8c63-c7780be57ff5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:34.936900 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-eea43868-30c3-4ce9-8c63-c7780be57ff5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:35.245290 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-eea43868-30c3-4ce9-8c63-c7780be57ff5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:35.263816 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-eea43868-30c3-4ce9-8c63-c7780be57ff5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:35.272609 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-eea43868-30c3-4ce9-8c63-c7780be57ff5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:35.274730 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-eea43868-30c3-4ce9-8c63-c7780be57ff5 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1732 microversion: 2.20 time: 0.416810 Jan 15 02:46:35.277117 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 412/786] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:34 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1732 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:46:35.903625 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ef019515-cae3-4313-9c28-2dc3ef309f08 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:35.904824 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ef019515-cae3-4313-9c28-2dc3ef309f08 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:35.918136 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ef019515-cae3-4313-9c28-2dc3ef309f08 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:35.918793 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ef019515-cae3-4313-9c28-2dc3ef309f08 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:35.920022 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ef019515-cae3-4313-9c28-2dc3ef309f08 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:35.921762 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ef019515-cae3-4313-9c28-2dc3ef309f08 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:36.265192 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-ef019515-cae3-4313-9c28-2dc3ef309f08 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:36.278424 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ef019515-cae3-4313-9c28-2dc3ef309f08 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1581 microversion: 2.1 time: 0.407665 Jan 15 02:46:36.279334 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 413/787] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:35 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1581 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:46:36.314595 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9f079f5d-eafe-42a8-9bc5-f3d331e5f2b8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:36.315830 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9f079f5d-eafe-42a8-9bc5-f3d331e5f2b8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:36.333539 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9f079f5d-eafe-42a8-9bc5-f3d331e5f2b8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:36.333539 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9f079f5d-eafe-42a8-9bc5-f3d331e5f2b8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:36.333539 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9f079f5d-eafe-42a8-9bc5-f3d331e5f2b8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:36.334239 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9f079f5d-eafe-42a8-9bc5-f3d331e5f2b8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:36.734650 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-9f079f5d-eafe-42a8-9bc5-f3d331e5f2b8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:36.763447 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-9f079f5d-eafe-42a8-9bc5-f3d331e5f2b8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:36.778323 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-9f079f5d-eafe-42a8-9bc5-f3d331e5f2b8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:36.780425 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9f079f5d-eafe-42a8-9bc5-f3d331e5f2b8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1732 microversion: 2.20 time: 0.487779 Jan 15 02:46:36.781468 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 414/788] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:36 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1732 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:46:36.792519 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f8200001-c208-4335-8759-6f155f575c8d tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 38201 microversion: 2.1 time: 10.496174 Jan 15 02:46:36.794238 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 375/789] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:26 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 38201 bytes in 10500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:46:37.305289 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-04a62cb6-a3ca-4620-84e3-c38214d3598d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:37.305987 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-04a62cb6-a3ca-4620-84e3-c38214d3598d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:37.315580 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-04a62cb6-a3ca-4620-84e3-c38214d3598d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:37.316088 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-04a62cb6-a3ca-4620-84e3-c38214d3598d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:37.316987 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-04a62cb6-a3ca-4620-84e3-c38214d3598d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:37.317510 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-04a62cb6-a3ca-4620-84e3-c38214d3598d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:37.696981 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-04a62cb6-a3ca-4620-84e3-c38214d3598d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:37.710373 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-04a62cb6-a3ca-4620-84e3-c38214d3598d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1581 microversion: 2.1 time: 0.416105 Jan 15 02:46:37.711417 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 415/790] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:37 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1581 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:46:37.818243 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d66d07c6-7db2-4c4c-af63-bac4a01e3ac9 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:37.819581 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d66d07c6-7db2-4c4c-af63-bac4a01e3ac9 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:37.827366 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-8535c102-9b7e-4f16-870d-c23ebba2f69e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:37.828305 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8535c102-9b7e-4f16-870d-c23ebba2f69e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:37.833803 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d66d07c6-7db2-4c4c-af63-bac4a01e3ac9 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:37.834661 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d66d07c6-7db2-4c4c-af63-bac4a01e3ac9 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:37.835819 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d66d07c6-7db2-4c4c-af63-bac4a01e3ac9 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:37.836462 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d66d07c6-7db2-4c4c-af63-bac4a01e3ac9 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:37.843508 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8535c102-9b7e-4f16-870d-c23ebba2f69e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:37.844442 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8535c102-9b7e-4f16-870d-c23ebba2f69e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:37.846213 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8535c102-9b7e-4f16-870d-c23ebba2f69e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:37.847049 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8535c102-9b7e-4f16-870d-c23ebba2f69e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:38.008202 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d66d07c6-7db2-4c4c-af63-bac4a01e3ac9 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 38201 microversion: 2.1 time: 0.202204 Jan 15 02:46:38.009765 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 376/791] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:37 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 38201 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:46:38.232241 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-8535c102-9b7e-4f16-870d-c23ebba2f69e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:38.264995 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-8535c102-9b7e-4f16-870d-c23ebba2f69e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:38.281717 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-8535c102-9b7e-4f16-870d-c23ebba2f69e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:38.284601 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-8535c102-9b7e-4f16-870d-c23ebba2f69e tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1732 microversion: 2.20 time: 0.475107 Jan 15 02:46:38.285984 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 416/792] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:37 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1732 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:46:38.757921 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-05f91301-604d-460f-aa1d-a721caeb3d73 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:38.759318 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-05f91301-604d-460f-aa1d-a721caeb3d73 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:38.774623 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-05f91301-604d-460f-aa1d-a721caeb3d73 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:38.775521 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-05f91301-604d-460f-aa1d-a721caeb3d73 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:38.777105 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-05f91301-604d-460f-aa1d-a721caeb3d73 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:38.777999 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-05f91301-604d-460f-aa1d-a721caeb3d73 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:39.027947 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b6d35102-34b1-4c2b-88d2-9b866b843a33 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:39.029046 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b6d35102-34b1-4c2b-88d2-9b866b843a33 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:39.038796 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b6d35102-34b1-4c2b-88d2-9b866b843a33 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:39.039311 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b6d35102-34b1-4c2b-88d2-9b866b843a33 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:39.040387 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b6d35102-34b1-4c2b-88d2-9b866b843a33 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:39.040889 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b6d35102-34b1-4c2b-88d2-9b866b843a33 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:39.171705 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-05f91301-604d-460f-aa1d-a721caeb3d73 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:39.187063 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b6d35102-34b1-4c2b-88d2-9b866b843a33 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 38201 microversion: 2.1 time: 0.167525 Jan 15 02:46:39.188187 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 417/793] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:39 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 38201 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:46:39.188441 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-05f91301-604d-460f-aa1d-a721caeb3d73 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1568 microversion: 2.1 time: 0.450265 Jan 15 02:46:39.189629 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 377/794] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:46:38 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1568 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:46:39.323469 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-af8d9ce8-62cb-484d-a494-f98af05a2df8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:39.324529 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-af8d9ce8-62cb-484d-a494-f98af05a2df8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:39.333731 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-af8d9ce8-62cb-484d-a494-f98af05a2df8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:39.334307 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-af8d9ce8-62cb-484d-a494-f98af05a2df8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:39.335175 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-af8d9ce8-62cb-484d-a494-f98af05a2df8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:39.335674 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-af8d9ce8-62cb-484d-a494-f98af05a2df8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:39.672367 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-af8d9ce8-62cb-484d-a494-f98af05a2df8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:39.689516 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-af8d9ce8-62cb-484d-a494-f98af05a2df8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:39.696723 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-af8d9ce8-62cb-484d-a494-f98af05a2df8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:39.698012 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-af8d9ce8-62cb-484d-a494-f98af05a2df8 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1732 microversion: 2.20 time: 0.386394 Jan 15 02:46:39.698900 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 418/795] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:39 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1732 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:46:40.216196 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e17512fe-3e5e-4dcc-a777-20359085cccc tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:40.217367 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e17512fe-3e5e-4dcc-a777-20359085cccc tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:40.226959 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e17512fe-3e5e-4dcc-a777-20359085cccc tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:40.227466 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e17512fe-3e5e-4dcc-a777-20359085cccc tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:40.228324 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e17512fe-3e5e-4dcc-a777-20359085cccc tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:40.228819 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e17512fe-3e5e-4dcc-a777-20359085cccc tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:40.377897 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e17512fe-3e5e-4dcc-a777-20359085cccc tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action" status: 200 len: 38330 microversion: 2.1 time: 0.177985 Jan 15 02:46:40.378644 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 378/796] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:46:40 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/action => generated 38330 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 02:46:40.395775 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-8a9cf310-cd29-4389-bd96-49194d5ef5b3 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:40.396454 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8a9cf310-cd29-4389-bd96-49194d5ef5b3 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:40.406012 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8a9cf310-cd29-4389-bd96-49194d5ef5b3 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:40.406524 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8a9cf310-cd29-4389-bd96-49194d5ef5b3 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:40.407952 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8a9cf310-cd29-4389-bd96-49194d5ef5b3 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:40.408606 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8a9cf310-cd29-4389-bd96-49194d5ef5b3 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:40.487361 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-8a9cf310-cd29-4389-bd96-49194d5ef5b3 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/ips" status: 200 len: 146 microversion: 2.1 time: 0.101264 Jan 15 02:46:40.487937 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 419/797] 10.222.0.37 () {58 vars in 1238 bytes} [Fri Jan 15 02:46:40 2021] GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/ips => generated 146 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:46:40.729256 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e3f5b45b-98bc-41c5-95aa-4ba19b4515eb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:40.730235 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e3f5b45b-98bc-41c5-95aa-4ba19b4515eb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:40.739986 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e3f5b45b-98bc-41c5-95aa-4ba19b4515eb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:40.740408 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e3f5b45b-98bc-41c5-95aa-4ba19b4515eb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:40.741300 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e3f5b45b-98bc-41c5-95aa-4ba19b4515eb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:40.741789 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e3f5b45b-98bc-41c5-95aa-4ba19b4515eb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:41.097960 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e3f5b45b-98bc-41c5-95aa-4ba19b4515eb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:41.115889 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e3f5b45b-98bc-41c5-95aa-4ba19b4515eb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:41.124565 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e3f5b45b-98bc-41c5-95aa-4ba19b4515eb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:41.126643 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e3f5b45b-98bc-41c5-95aa-4ba19b4515eb tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1732 microversion: 2.20 time: 0.409900 Jan 15 02:46:41.127676 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 379/798] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:40 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1732 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:46:41.326040 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-985f286f-4cce-4f61-ae9a-aaa008caf132 req-e98f9667-e8a9-4b95-a71e-ac1a6d0070b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "813b0cda-aa4a-4e8d-a4c7-2042b9415e81", "name": "network-vif-plugged", "status": "completed", "tag": "6e4e5bd0-fe30-49a1-b6cb-89dcd970bde9"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:41.334254 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:46:41.334254 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:46:41.349204 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-985f286f-4cce-4f61-ae9a-aaa008caf132 req-e98f9667-e8a9-4b95-a71e-ac1a6d0070b1 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:41.349721 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-985f286f-4cce-4f61-ae9a-aaa008caf132 req-e98f9667-e8a9-4b95-a71e-ac1a6d0070b1 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:41.370641 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-985f286f-4cce-4f61-ae9a-aaa008caf132 req-e98f9667-e8a9-4b95-a71e-ac1a6d0070b1 service nova] Creating event network-vif-plugged:6e4e5bd0-fe30-49a1-b6cb-89dcd970bde9 for instance 813b0cda-aa4a-4e8d-a4c7-2042b9415e81 on hv-cinder-76330 Jan 15 02:46:41.376726 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-985f286f-4cce-4f61-ae9a-aaa008caf132 req-e98f9667-e8a9-4b95-a71e-ac1a6d0070b1 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060542 Jan 15 02:46:41.377600 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 420/799] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:46:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:46:42.155945 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-cdd87ca2-90f9-411b-8c7c-c626ede4b88b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:42.156614 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-cdd87ca2-90f9-411b-8c7c-c626ede4b88b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:42.166536 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cdd87ca2-90f9-411b-8c7c-c626ede4b88b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:42.167043 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cdd87ca2-90f9-411b-8c7c-c626ede4b88b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:42.167893 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cdd87ca2-90f9-411b-8c7c-c626ede4b88b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:42.168404 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cdd87ca2-90f9-411b-8c7c-c626ede4b88b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:42.335907 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-31792e70-8629-4784-8670-157ac465a489 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ddb8990-2563-47e8-b66c-d194d40e7704"}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:42.337250 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-31792e70-8629-4784-8670-157ac465a489 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:42.346779 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-31792e70-8629-4784-8670-157ac465a489 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:42.347293 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-31792e70-8629-4784-8670-157ac465a489 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:42.348155 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-31792e70-8629-4784-8670-157ac465a489 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:42.348650 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-31792e70-8629-4784-8670-157ac465a489 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:42.458594 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-cdd87ca2-90f9-411b-8c7c-c626ede4b88b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:42.474133 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-cdd87ca2-90f9-411b-8c7c-c626ede4b88b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:42.481600 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-cdd87ca2-90f9-411b-8c7c-c626ede4b88b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:42.482881 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-cdd87ca2-90f9-411b-8c7c-c626ede4b88b tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1732 microversion: 2.20 time: 0.339164 Jan 15 02:46:42.483454 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 380/800] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:42 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1732 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:46:42.802477 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-31792e70-8629-4784-8670-157ac465a489 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.476825 Jan 15 02:46:42.808674 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 421/801] 10.222.0.37 () {60 vars in 1313 bytes} [Fri Jan 15 02:46:42 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/os-volume_attachments => generated 194 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:46:43.517694 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-acb8a4b7-85a4-4d94-bd75-c5852f841d68 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:43.519129 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-acb8a4b7-85a4-4d94-bd75-c5852f841d68 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:43.531122 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-acb8a4b7-85a4-4d94-bd75-c5852f841d68 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:43.532123 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-acb8a4b7-85a4-4d94-bd75-c5852f841d68 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:43.534366 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-acb8a4b7-85a4-4d94-bd75-c5852f841d68 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:43.535022 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-acb8a4b7-85a4-4d94-bd75-c5852f841d68 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:43.864235 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-acb8a4b7-85a4-4d94-bd75-c5852f841d68 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:43.884267 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-acb8a4b7-85a4-4d94-bd75-c5852f841d68 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:43.894369 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-acb8a4b7-85a4-4d94-bd75-c5852f841d68 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:43.895640 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-acb8a4b7-85a4-4d94-bd75-c5852f841d68 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1732 microversion: 2.20 time: 0.395622 Jan 15 02:46:43.896239 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 381/802] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:43 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1732 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:46:44.929654 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6137dfd2-4c42-4ad9-9367-f42e7bf67927 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:44.930496 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6137dfd2-4c42-4ad9-9367-f42e7bf67927 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:44.940084 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6137dfd2-4c42-4ad9-9367-f42e7bf67927 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:44.940604 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6137dfd2-4c42-4ad9-9367-f42e7bf67927 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:44.941492 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6137dfd2-4c42-4ad9-9367-f42e7bf67927 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:44.941988 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6137dfd2-4c42-4ad9-9367-f42e7bf67927 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:45.247474 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6137dfd2-4c42-4ad9-9367-f42e7bf67927 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:45.262291 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6137dfd2-4c42-4ad9-9367-f42e7bf67927 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:45.269462 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6137dfd2-4c42-4ad9-9367-f42e7bf67927 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:46:45.270769 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6137dfd2-4c42-4ad9-9367-f42e7bf67927 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1719 microversion: 2.20 time: 0.351833 Jan 15 02:46:45.271362 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 422/803] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:46:44 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1719 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:46:50.853463 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-adfac3a3-6b7f-40be-b9a3-6b5f24490f04 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:50.854526 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-adfac3a3-6b7f-40be-b9a3-6b5f24490f04 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:50.865498 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-adfac3a3-6b7f-40be-b9a3-6b5f24490f04 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:50.866009 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-adfac3a3-6b7f-40be-b9a3-6b5f24490f04 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:50.866880 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-adfac3a3-6b7f-40be-b9a3-6b5f24490f04 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:50.867377 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-adfac3a3-6b7f-40be-b9a3-6b5f24490f04 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:50.957118 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-adfac3a3-6b7f-40be-b9a3-6b5f24490f04 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114212 Jan 15 02:46:50.957679 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 382/804] 10.222.0.37 () {58 vars in 1292 bytes} [Fri Jan 15 02:46:50 2021] GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:46:50.983743 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4a9fd874-67d4-4375-8e50-5012f3ad4241 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:46:50.984744 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4a9fd874-67d4-4375-8e50-5012f3ad4241 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:51.000937 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4a9fd874-67d4-4375-8e50-5012f3ad4241 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:51.002504 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4a9fd874-67d4-4375-8e50-5012f3ad4241 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:51.003746 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4a9fd874-67d4-4375-8e50-5012f3ad4241 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:51.004249 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4a9fd874-67d4-4375-8e50-5012f3ad4241 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:51.089594 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4a9fd874-67d4-4375-8e50-5012f3ad4241 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/os-volume_attachments/9ddb8990-2563-47e8-b66c-d194d40e7704" status: 200 len: 194 microversion: 2.1 time: 0.124697 Jan 15 02:46:51.090412 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 423/805] 10.222.0.37 () {58 vars in 1403 bytes} [Fri Jan 15 02:46:50 2021] GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/os-volume_attachments/9ddb8990-2563-47e8-b66c-d194d40e7704 => generated 194 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:46:52.799331 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-8b6b0022-dd07-43b7-85c7-1a206bbad39e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58484f1f-d43d-4a11-aa54-8b1b4f566697"}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:46:52.800563 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8b6b0022-dd07-43b7-85c7-1a206bbad39e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:46:52.808603 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8b6b0022-dd07-43b7-85c7-1a206bbad39e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:52.809144 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8b6b0022-dd07-43b7-85c7-1a206bbad39e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:52.809991 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8b6b0022-dd07-43b7-85c7-1a206bbad39e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:46:52.810482 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8b6b0022-dd07-43b7-85c7-1a206bbad39e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:46:53.233600 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-8b6b0022-dd07-43b7-85c7-1a206bbad39e tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.444762 Jan 15 02:46:53.234270 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 383/806] 10.222.0.37 () {60 vars in 1313 bytes} [Fri Jan 15 02:46:52 2021] POST /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/os-volume_attachments => generated 194 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:47:03.373519 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-67b91937-ca7f-4514-9862-6bb3687a8374 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:03.374737 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-67b91937-ca7f-4514-9862-6bb3687a8374 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:03.384818 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-67b91937-ca7f-4514-9862-6bb3687a8374 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:03.385376 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-67b91937-ca7f-4514-9862-6bb3687a8374 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:03.386243 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-67b91937-ca7f-4514-9862-6bb3687a8374 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:03.386737 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-67b91937-ca7f-4514-9862-6bb3687a8374 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:03.476956 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-67b91937-ca7f-4514-9862-6bb3687a8374 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.112823 Jan 15 02:47:03.477640 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 424/807] 10.222.0.37 () {58 vars in 1292 bytes} [Fri Jan 15 02:47:03 2021] GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/os-volume_attachments => generated 371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:47:03.776511 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3c96cc71-f270-44ae-ace6-a9ef94ff1a09 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:03.777212 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3c96cc71-f270-44ae-ace6-a9ef94ff1a09 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:03.787399 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3c96cc71-f270-44ae-ace6-a9ef94ff1a09 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:03.787923 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3c96cc71-f270-44ae-ace6-a9ef94ff1a09 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:03.788818 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3c96cc71-f270-44ae-ace6-a9ef94ff1a09 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:03.789364 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3c96cc71-f270-44ae-ace6-a9ef94ff1a09 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:03.871816 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3c96cc71-f270-44ae-ace6-a9ef94ff1a09 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/os-volume_attachments/9ddb8990-2563-47e8-b66c-d194d40e7704" status: 200 len: 194 microversion: 2.1 time: 0.108218 Jan 15 02:47:03.872507 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 384/808] 10.222.0.37 () {58 vars in 1403 bytes} [Fri Jan 15 02:47:03 2021] GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/os-volume_attachments/9ddb8990-2563-47e8-b66c-d194d40e7704 => generated 194 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:47:03.889811 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4273a0fb-7631-4693-92c7-393633ce35c2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:03.890369 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4273a0fb-7631-4693-92c7-393633ce35c2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:03.899296 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4273a0fb-7631-4693-92c7-393633ce35c2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:03.899821 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4273a0fb-7631-4693-92c7-393633ce35c2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:03.900713 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4273a0fb-7631-4693-92c7-393633ce35c2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:03.901261 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4273a0fb-7631-4693-92c7-393633ce35c2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:04.278592 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4273a0fb-7631-4693-92c7-393633ce35c2 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "DELETE /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/os-volume_attachments/9ddb8990-2563-47e8-b66c-d194d40e7704" status: 202 len: 0 microversion: 2.1 time: 0.398194 Jan 15 02:47:04.279446 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 425/809] 10.222.0.37 () {58 vars in 1406 bytes} [Fri Jan 15 02:47:03 2021] DELETE /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/os-volume_attachments/9ddb8990-2563-47e8-b66c-d194d40e7704 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:47:06.730907 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-327c2cdd-9d81-4083-a35a-5ca496c29032 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:06.731508 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-327c2cdd-9d81-4083-a35a-5ca496c29032 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:06.741100 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-327c2cdd-9d81-4083-a35a-5ca496c29032 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:06.741614 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-327c2cdd-9d81-4083-a35a-5ca496c29032 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:06.742472 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-327c2cdd-9d81-4083-a35a-5ca496c29032 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:06.742961 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-327c2cdd-9d81-4083-a35a-5ca496c29032 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:06.826086 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-327c2cdd-9d81-4083-a35a-5ca496c29032 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/os-volume_attachments/58484f1f-d43d-4a11-aa54-8b1b4f566697" status: 200 len: 194 microversion: 2.1 time: 0.107382 Jan 15 02:47:06.826768 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 385/810] 10.222.0.37 () {58 vars in 1403 bytes} [Fri Jan 15 02:47:06 2021] GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/os-volume_attachments/58484f1f-d43d-4a11-aa54-8b1b4f566697 => generated 194 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:47:06.844311 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6e2564c0-c618-4e7f-8e21-728ee0532930 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:06.845844 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6e2564c0-c618-4e7f-8e21-728ee0532930 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:06.854657 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6e2564c0-c618-4e7f-8e21-728ee0532930 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:06.855176 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6e2564c0-c618-4e7f-8e21-728ee0532930 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:06.856039 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6e2564c0-c618-4e7f-8e21-728ee0532930 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:06.856538 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6e2564c0-c618-4e7f-8e21-728ee0532930 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:07.213108 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6e2564c0-c618-4e7f-8e21-728ee0532930 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "DELETE /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/os-volume_attachments/58484f1f-d43d-4a11-aa54-8b1b4f566697" status: 202 len: 0 microversion: 2.1 time: 0.378248 Jan 15 02:47:07.213772 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 426/811] 10.222.0.37 () {58 vars in 1406 bytes} [Fri Jan 15 02:47:06 2021] DELETE /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432/os-volume_attachments/58484f1f-d43d-4a11-aa54-8b1b4f566697 => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 02:47:12.234142 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c618dcc9-7ed1-4a90-9deb-8a166cfd4771 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:12.234702 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c618dcc9-7ed1-4a90-9deb-8a166cfd4771 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:12.243682 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c618dcc9-7ed1-4a90-9deb-8a166cfd4771 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:12.244227 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c618dcc9-7ed1-4a90-9deb-8a166cfd4771 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:12.245114 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c618dcc9-7ed1-4a90-9deb-8a166cfd4771 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:12.245616 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c618dcc9-7ed1-4a90-9deb-8a166cfd4771 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:12.325667 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c618dcc9-7ed1-4a90-9deb-8a166cfd4771 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Going to try to terminate instance {{(pid=94112) delete /opt/stack/nova/nova/compute/api.py:2535}} Jan 15 02:47:12.458869 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c618dcc9-7ed1-4a90-9deb-8a166cfd4771 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "DELETE /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432" status: 204 len: 0 microversion: 2.1 time: 0.233637 Jan 15 02:47:12.459443 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 386/812] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:47:12 2021] DELETE /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 02:47:12.477133 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-0c469008-5d3d-40bd-8458-e6965b0630b5 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:12.477893 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-0c469008-5d3d-40bd-8458-e6965b0630b5 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:12.488470 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0c469008-5d3d-40bd-8458-e6965b0630b5 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:12.488957 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0c469008-5d3d-40bd-8458-e6965b0630b5 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:12.490024 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0c469008-5d3d-40bd-8458-e6965b0630b5 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:12.491237 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0c469008-5d3d-40bd-8458-e6965b0630b5 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:12.768004 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0c469008-5d3d-40bd-8458-e6965b0630b5 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:47:12.777344 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-0c469008-5d3d-40bd-8458-e6965b0630b5 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432" status: 200 len: 1673 microversion: 2.1 time: 0.312974 Jan 15 02:47:12.777954 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 427/813] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:47:12 2021] GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432 => generated 1673 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:47:13.807740 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-56bf420f-91fb-47a8-83fb-0de274843841 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:13.808681 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-56bf420f-91fb-47a8-83fb-0de274843841 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:13.818041 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-56bf420f-91fb-47a8-83fb-0de274843841 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:13.818552 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-56bf420f-91fb-47a8-83fb-0de274843841 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:13.819413 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-56bf420f-91fb-47a8-83fb-0de274843841 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:13.819904 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-56bf420f-91fb-47a8-83fb-0de274843841 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:14.109602 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-56bf420f-91fb-47a8-83fb-0de274843841 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:47:14.119907 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-56bf420f-91fb-47a8-83fb-0de274843841 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432" status: 200 len: 1673 microversion: 2.1 time: 0.325057 Jan 15 02:47:14.120546 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 387/814] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:47:13 2021] GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432 => generated 1673 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:47:15.004813 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-c843af59-72d2-431b-bd4b-1a1e71bcb95c req-63d93f66-b969-4115-a2c7-5e42fafde0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec845a88-1a81-4890-9963-9936491ed432", "name": "network-vif-unplugged", "status": "completed", "tag": "a9e4c21b-46c5-4fe7-a02b-5c5ab9343130"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:47:15.020220 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:47:15.020220 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:47:15.040083 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-c843af59-72d2-431b-bd4b-1a1e71bcb95c req-63d93f66-b969-4115-a2c7-5e42fafde0c7 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:15.040940 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-c843af59-72d2-431b-bd4b-1a1e71bcb95c req-63d93f66-b969-4115-a2c7-5e42fafde0c7 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:15.075193 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-c843af59-72d2-431b-bd4b-1a1e71bcb95c req-63d93f66-b969-4115-a2c7-5e42fafde0c7 service nova] Creating event network-vif-unplugged:a9e4c21b-46c5-4fe7-a02b-5c5ab9343130 for instance ec845a88-1a81-4890-9963-9936491ed432 on hv-cinder-76330 Jan 15 02:47:15.090359 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-c843af59-72d2-431b-bd4b-1a1e71bcb95c req-63d93f66-b969-4115-a2c7-5e42fafde0c7 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110770 Jan 15 02:47:15.091773 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 428/815] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:47:14 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:47:15.153584 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-0bd01c6b-6571-4bff-af32-50bcfd597e0c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:15.154764 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-0bd01c6b-6571-4bff-af32-50bcfd597e0c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:15.169615 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0bd01c6b-6571-4bff-af32-50bcfd597e0c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:15.170449 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0bd01c6b-6571-4bff-af32-50bcfd597e0c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:15.171865 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0bd01c6b-6571-4bff-af32-50bcfd597e0c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:15.173298 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0bd01c6b-6571-4bff-af32-50bcfd597e0c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:15.494463 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0bd01c6b-6571-4bff-af32-50bcfd597e0c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:47:15.504477 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-0bd01c6b-6571-4bff-af32-50bcfd597e0c tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432" status: 200 len: 1673 microversion: 2.1 time: 0.369847 Jan 15 02:47:15.505113 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 388/816] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:47:15 2021] GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432 => generated 1673 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:47:16.554101 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1dc05800-9347-43c0-850a-25dc102a3c80 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:16.556652 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1dc05800-9347-43c0-850a-25dc102a3c80 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:16.572876 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-61403cdc-b50d-4197-beed-4fa055c94307 req-1c0365de-1bd3-43aa-a8c0-80c50a0b808d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec845a88-1a81-4890-9963-9936491ed432", "name": "network-vif-deleted", "tag": "a9e4c21b-46c5-4fe7-a02b-5c5ab9343130"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:47:16.603730 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1dc05800-9347-43c0-850a-25dc102a3c80 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:16.604628 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1dc05800-9347-43c0-850a-25dc102a3c80 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:16.606306 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1dc05800-9347-43c0-850a-25dc102a3c80 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:16.607241 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1dc05800-9347-43c0-850a-25dc102a3c80 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:16.618816 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:47:16.618816 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:47:16.645403 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-61403cdc-b50d-4197-beed-4fa055c94307 req-1c0365de-1bd3-43aa-a8c0-80c50a0b808d service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:16.646575 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-61403cdc-b50d-4197-beed-4fa055c94307 req-1c0365de-1bd3-43aa-a8c0-80c50a0b808d service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:16.692111 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-61403cdc-b50d-4197-beed-4fa055c94307 req-1c0365de-1bd3-43aa-a8c0-80c50a0b808d service nova] Creating event network-vif-deleted:a9e4c21b-46c5-4fe7-a02b-5c5ab9343130 for instance ec845a88-1a81-4890-9963-9936491ed432 on hv-cinder-76330 Jan 15 02:47:16.703426 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-61403cdc-b50d-4197-beed-4fa055c94307 req-1c0365de-1bd3-43aa-a8c0-80c50a0b808d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160093 Jan 15 02:47:16.706466 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 389/817] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:47:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:47:16.980820 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1dc05800-9347-43c0-850a-25dc102a3c80 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89505fd3686440cc939ec8fbe725ee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae05708286f4222bc7584d7b1dea622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:47:16.998219 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1dc05800-9347-43c0-850a-25dc102a3c80 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432" status: 200 len: 1321 microversion: 2.1 time: 0.477347 Jan 15 02:47:17.004833 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 429/818] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:47:16 2021] GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432 => generated 1321 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:47:18.048896 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f005b568-19e7-49e6-a004-8b367b3eac41 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:18.050670 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f005b568-19e7-49e6-a004-8b367b3eac41 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:18.068650 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f005b568-19e7-49e6-a004-8b367b3eac41 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:18.069617 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f005b568-19e7-49e6-a004-8b367b3eac41 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:18.071254 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f005b568-19e7-49e6-a004-8b367b3eac41 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:18.072260 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f005b568-19e7-49e6-a004-8b367b3eac41 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:18.135537 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-f005b568-19e7-49e6-a004-8b367b3eac41 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] HTTP exception thrown: Instance ec845a88-1a81-4890-9963-9936491ed432 could not be found. Jan 15 02:47:18.136218 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f005b568-19e7-49e6-a004-8b367b3eac41 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Returning 404 to user: Instance ec845a88-1a81-4890-9963-9936491ed432 could not be found. {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:47:18.137259 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f005b568-19e7-49e6-a004-8b367b3eac41 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432" status: 404 len: 111 microversion: 2.1 time: 0.111405 Jan 15 02:47:18.138147 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 390/819] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:47:18 2021] GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:47:18.154235 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-493de8e7-f80e-4783-881b-4a7f208c4e55 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '.version_select at 0x7f878e76b0d0>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:18.181211 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-493de8e7-f80e-4783-881b-4a7f208c4e55 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-319502259" status: 202 len: 0 microversion: 2.1 time: 0.036199 Jan 15 02:47:18.182958 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 430/820] 10.222.0.37 () {58 vars in 1208 bytes} [Fri Jan 15 02:47:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-319502259 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:47:22.324601 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5a5bf712-70a4-4c76-b290-fba095d2d6f6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:22.325178 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5a5bf712-70a4-4c76-b290-fba095d2d6f6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:22.334322 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5a5bf712-70a4-4c76-b290-fba095d2d6f6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:22.334828 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5a5bf712-70a4-4c76-b290-fba095d2d6f6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:22.335680 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5a5bf712-70a4-4c76-b290-fba095d2d6f6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:22.336172 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5a5bf712-70a4-4c76-b290-fba095d2d6f6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:22.389651 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-5a5bf712-70a4-4c76-b290-fba095d2d6f6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] HTTP exception thrown: Instance ec845a88-1a81-4890-9963-9936491ed432 could not be found. Jan 15 02:47:22.390316 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5a5bf712-70a4-4c76-b290-fba095d2d6f6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Returning 404 to user: Instance ec845a88-1a81-4890-9963-9936491ed432 could not be found. {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:47:22.391883 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5a5bf712-70a4-4c76-b290-fba095d2d6f6 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "DELETE /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432" status: 404 len: 111 microversion: 2.1 time: 0.076035 Jan 15 02:47:22.392452 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 391/821] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:47:22 2021] DELETE /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:47:22.406908 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5f83be5a-f57f-4c2d-8b9b-c0980ba6587a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:22.407957 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5f83be5a-f57f-4c2d-8b9b-c0980ba6587a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: ec845a88-1a81-4890-9963-9936491ed432] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:22.416760 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5f83be5a-f57f-4c2d-8b9b-c0980ba6587a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:22.417334 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5f83be5a-f57f-4c2d-8b9b-c0980ba6587a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:22.418194 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5f83be5a-f57f-4c2d-8b9b-c0980ba6587a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:22.418729 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5f83be5a-f57f-4c2d-8b9b-c0980ba6587a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:22.483661 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-5f83be5a-f57f-4c2d-8b9b-c0980ba6587a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] HTTP exception thrown: Instance ec845a88-1a81-4890-9963-9936491ed432 could not be found. Jan 15 02:47:22.484249 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5f83be5a-f57f-4c2d-8b9b-c0980ba6587a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Returning 404 to user: Instance ec845a88-1a81-4890-9963-9936491ed432 could not be found. {{(pid=94111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:47:22.485754 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5f83be5a-f57f-4c2d-8b9b-c0980ba6587a tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432" status: 404 len: 111 microversion: 2.1 time: 0.088758 Jan 15 02:47:22.486373 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 431/822] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:47:22 2021] GET /compute/v2.1/servers/ec845a88-1a81-4890-9963-9936491ed432 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:47:24.851064 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-14385f8a-9757-4ac5-b402-6201cd1a5059 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:24.851622 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-14385f8a-9757-4ac5-b402-6201cd1a5059 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:24.860174 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-14385f8a-9757-4ac5-b402-6201cd1a5059 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:24.860690 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-14385f8a-9757-4ac5-b402-6201cd1a5059 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:24.861737 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-14385f8a-9757-4ac5-b402-6201cd1a5059 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:24.862235 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-14385f8a-9757-4ac5-b402-6201cd1a5059 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:24.916692 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-14385f8a-9757-4ac5-b402-6201cd1a5059 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] HTTP exception thrown: Instance 6e38a45f-624e-4ca4-9f81-3d92ce319b50 could not be found. Jan 15 02:47:24.917395 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-14385f8a-9757-4ac5-b402-6201cd1a5059 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Returning 404 to user: Instance 6e38a45f-624e-4ca4-9f81-3d92ce319b50 could not be found. {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:47:24.918311 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-14385f8a-9757-4ac5-b402-6201cd1a5059 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "DELETE /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 404 len: 111 microversion: 2.1 time: 0.076874 Jan 15 02:47:24.918929 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 392/823] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:47:24 2021] DELETE /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:47:24.933619 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3a3ae601-b5e2-4d98-89eb-f3bb3672ba90 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:24.934304 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3a3ae601-b5e2-4d98-89eb-f3bb3672ba90 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] [instance: 6e38a45f-624e-4ca4-9f81-3d92ce319b50] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:24.943167 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a3ae601-b5e2-4d98-89eb-f3bb3672ba90 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:24.943670 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a3ae601-b5e2-4d98-89eb-f3bb3672ba90 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:24.944523 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a3ae601-b5e2-4d98-89eb-f3bb3672ba90 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:24.945044 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a3ae601-b5e2-4d98-89eb-f3bb3672ba90 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:24.998084 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-3a3ae601-b5e2-4d98-89eb-f3bb3672ba90 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] HTTP exception thrown: Instance 6e38a45f-624e-4ca4-9f81-3d92ce319b50 could not be found. Jan 15 02:47:24.999828 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3a3ae601-b5e2-4d98-89eb-f3bb3672ba90 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] Returning 404 to user: Instance 6e38a45f-624e-4ca4-9f81-3d92ce319b50 could not be found. {{(pid=94111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:47:24.999828 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3a3ae601-b5e2-4d98-89eb-f3bb3672ba90 tempest-AttachVolumeTestJSON-716016270 tempest-AttachVolumeTestJSON-716016270] 10.222.0.37 "GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50" status: 404 len: 111 microversion: 2.1 time: 0.075675 Jan 15 02:47:25.001277 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 432/824] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:47:24 2021] GET /compute/v2.1/servers/6e38a45f-624e-4ca4-9f81-3d92ce319b50 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:47:27.376053 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5abf1ed9-6adc-409d-9f4f-b93d6fc7578c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:27.377324 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5abf1ed9-6adc-409d-9f4f-b93d6fc7578c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:27.385761 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5abf1ed9-6adc-409d-9f4f-b93d6fc7578c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:27.386548 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5abf1ed9-6adc-409d-9f4f-b93d6fc7578c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:27.387868 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5abf1ed9-6adc-409d-9f4f-b93d6fc7578c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:27.388525 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5abf1ed9-6adc-409d-9f4f-b93d6fc7578c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:27.488819 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5abf1ed9-6adc-409d-9f4f-b93d6fc7578c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Going to try to terminate instance {{(pid=94112) delete /opt/stack/nova/nova/compute/api.py:2535}} Jan 15 02:47:27.635259 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5abf1ed9-6adc-409d-9f4f-b93d6fc7578c tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "DELETE /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 204 len: 0 microversion: 2.20 time: 0.268668 Jan 15 02:47:27.636067 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 393/825] 10.222.0.37 () {60 vars in 1270 bytes} [Fri Jan 15 02:47:27 2021] DELETE /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 02:47:27.652089 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-0182fb46-c96e-41c9-837b-15dfbd1533f0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:27.653059 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-0182fb46-c96e-41c9-837b-15dfbd1533f0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:27.662290 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0182fb46-c96e-41c9-837b-15dfbd1533f0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:27.663082 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0182fb46-c96e-41c9-837b-15dfbd1533f0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:27.664118 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0182fb46-c96e-41c9-837b-15dfbd1533f0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:27.664768 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0182fb46-c96e-41c9-837b-15dfbd1533f0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:28.142971 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0182fb46-c96e-41c9-837b-15dfbd1533f0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:47:28.158081 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0182fb46-c96e-41c9-837b-15dfbd1533f0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:47:28.164694 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0182fb46-c96e-41c9-837b-15dfbd1533f0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:47:28.165941 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-0182fb46-c96e-41c9-837b-15dfbd1533f0 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1725 microversion: 2.20 time: 0.523849 Jan 15 02:47:28.166803 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 433/826] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:47:27 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1725 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:47:29.192775 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-928e4275-0f20-41e8-86db-db27538fe02d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:29.193579 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-928e4275-0f20-41e8-86db-db27538fe02d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:29.201783 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-928e4275-0f20-41e8-86db-db27538fe02d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:29.202271 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-928e4275-0f20-41e8-86db-db27538fe02d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:29.203942 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-928e4275-0f20-41e8-86db-db27538fe02d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:29.204416 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-928e4275-0f20-41e8-86db-db27538fe02d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:29.506777 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-928e4275-0f20-41e8-86db-db27538fe02d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:47:29.524516 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-928e4275-0f20-41e8-86db-db27538fe02d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:47:29.531429 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-928e4275-0f20-41e8-86db-db27538fe02d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:47:29.532797 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-928e4275-0f20-41e8-86db-db27538fe02d tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1725 microversion: 2.20 time: 0.350870 Jan 15 02:47:29.534005 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 394/827] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:47:29 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1725 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:47:30.558133 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-40347be3-c8b4-4713-b50a-00ff06b81366 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:30.559048 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-40347be3-c8b4-4713-b50a-00ff06b81366 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:30.569452 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-40347be3-c8b4-4713-b50a-00ff06b81366 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:30.570062 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-40347be3-c8b4-4713-b50a-00ff06b81366 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:30.571099 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-40347be3-c8b4-4713-b50a-00ff06b81366 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:30.571590 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-40347be3-c8b4-4713-b50a-00ff06b81366 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:31.266613 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-40347be3-c8b4-4713-b50a-00ff06b81366 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:47:31.294107 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-40347be3-c8b4-4713-b50a-00ff06b81366 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:47:31.303062 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-40347be3-c8b4-4713-b50a-00ff06b81366 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:47:31.304655 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-40347be3-c8b4-4713-b50a-00ff06b81366 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1725 microversion: 2.20 time: 0.756236 Jan 15 02:47:31.305501 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 434/828] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:47:30 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1725 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 02:47:32.040434 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-1b4c29b3-062b-42e6-b4d2-b88d04d722b6 req-c4adffbf-9e01-42a0-8a81-c81d0dc28671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "813b0cda-aa4a-4e8d-a4c7-2042b9415e81", "name": "network-vif-deleted", "tag": "6e4e5bd0-fe30-49a1-b6cb-89dcd970bde9"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:47:32.050421 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:47:32.050421 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:47:32.075858 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-1b4c29b3-062b-42e6-b4d2-b88d04d722b6 req-c4adffbf-9e01-42a0-8a81-c81d0dc28671 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:32.077361 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-1b4c29b3-062b-42e6-b4d2-b88d04d722b6 req-c4adffbf-9e01-42a0-8a81-c81d0dc28671 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:32.103373 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-1b4c29b3-062b-42e6-b4d2-b88d04d722b6 req-c4adffbf-9e01-42a0-8a81-c81d0dc28671 service nova] Creating event network-vif-deleted:6e4e5bd0-fe30-49a1-b6cb-89dcd970bde9 for instance 813b0cda-aa4a-4e8d-a4c7-2042b9415e81 on hv-cinder-76330 Jan 15 02:47:32.114821 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-1b4c29b3-062b-42e6-b4d2-b88d04d722b6 req-c4adffbf-9e01-42a0-8a81-c81d0dc28671 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086066 Jan 15 02:47:32.115725 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 395/829] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:47:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:47:32.330731 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-78f8e76c-3a08-41b3-a12d-0b6383bc9017 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:32.334181 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-78f8e76c-3a08-41b3-a12d-0b6383bc9017 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:32.352151 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-78f8e76c-3a08-41b3-a12d-0b6383bc9017 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:32.355034 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-78f8e76c-3a08-41b3-a12d-0b6383bc9017 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:32.357230 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-78f8e76c-3a08-41b3-a12d-0b6383bc9017 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:32.358895 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-78f8e76c-3a08-41b3-a12d-0b6383bc9017 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:32.479227 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-78f8e76c-3a08-41b3-a12d-0b6383bc9017 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:32.480000 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-78f8e76c-3a08-41b3-a12d-0b6383bc9017 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:32.480819 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.objects.instance [None req-78f8e76c-3a08-41b3-a12d-0b6383bc9017 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lazy-loading 'fault' on Instance uuid 813b0cda-aa4a-4e8d-a4c7-2042b9415e81 {{(pid=94111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Jan 15 02:47:33.045290 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-78f8e76c-3a08-41b3-a12d-0b6383bc9017 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:47:33.081406 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-78f8e76c-3a08-41b3-a12d-0b6383bc9017 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:47:33.098161 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-78f8e76c-3a08-41b3-a12d-0b6383bc9017 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9698bc5c912a4f86a7f0961c3cd41364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4201fdfaa594ca28ac9f59debb11e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:47:33.099696 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-78f8e76c-3a08-41b3-a12d-0b6383bc9017 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 200 len: 1371 microversion: 2.20 time: 0.779558 Jan 15 02:47:33.100328 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 435/830] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:47:32 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 1371 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 02:47:34.129105 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4ea77469-b65c-4e51-92e7-5615a5c56359 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:34.131058 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4ea77469-b65c-4e51-92e7-5615a5c56359 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:34.141915 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4ea77469-b65c-4e51-92e7-5615a5c56359 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:34.142793 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4ea77469-b65c-4e51-92e7-5615a5c56359 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:34.143884 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4ea77469-b65c-4e51-92e7-5615a5c56359 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:34.144570 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4ea77469-b65c-4e51-92e7-5615a5c56359 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:34.211809 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-4ea77469-b65c-4e51-92e7-5615a5c56359 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] HTTP exception thrown: Instance 813b0cda-aa4a-4e8d-a4c7-2042b9415e81 could not be found. Jan 15 02:47:34.212993 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4ea77469-b65c-4e51-92e7-5615a5c56359 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Returning 404 to user: Instance 813b0cda-aa4a-4e8d-a4c7-2042b9415e81 could not be found. {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:47:34.214120 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4ea77469-b65c-4e51-92e7-5615a5c56359 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 404 len: 111 microversion: 2.20 time: 0.097569 Jan 15 02:47:34.219214 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 396/831] 10.222.0.37 () {60 vars in 1267 bytes} [Fri Jan 15 02:47:34 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 02:47:34.230712 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-15ff342f-0e25-47e0-83ed-41fdca1e8947 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '.version_select at 0x7f878e76b268>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:34.261808 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-15ff342f-0e25-47e0-83ed-41fdca1e8947 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-777976179" status: 204 len: 0 microversion: 2.20 time: 0.040410 Jan 15 02:47:34.262753 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 436/832] 10.222.0.37 () {60 vars in 1249 bytes} [Fri Jan 15 02:47:34 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-777976179 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 02:47:37.560108 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-bbbc6682-d64b-4f41-9340-1b7ee8e10087 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:37.560680 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-bbbc6682-d64b-4f41-9340-1b7ee8e10087 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:37.576260 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bbbc6682-d64b-4f41-9340-1b7ee8e10087 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:37.576776 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bbbc6682-d64b-4f41-9340-1b7ee8e10087 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:37.578268 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bbbc6682-d64b-4f41-9340-1b7ee8e10087 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:37.578708 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-bbbc6682-d64b-4f41-9340-1b7ee8e10087 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:37.655028 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-bbbc6682-d64b-4f41-9340-1b7ee8e10087 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] HTTP exception thrown: Instance 813b0cda-aa4a-4e8d-a4c7-2042b9415e81 could not be found. Jan 15 02:47:37.658731 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-bbbc6682-d64b-4f41-9340-1b7ee8e10087 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Returning 404 to user: Instance 813b0cda-aa4a-4e8d-a4c7-2042b9415e81 could not be found. {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:47:37.660522 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-bbbc6682-d64b-4f41-9340-1b7ee8e10087 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "DELETE /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 404 len: 111 microversion: 2.1 time: 0.114374 Jan 15 02:47:37.664154 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 397/833] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:47:37 2021] DELETE /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:47:37.681874 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-fb99085e-380a-4e8e-8d20-4bde9fe13439 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:37.685610 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-fb99085e-380a-4e8e-8d20-4bde9fe13439 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: 813b0cda-aa4a-4e8d-a4c7-2042b9415e81] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:37.704422 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fb99085e-380a-4e8e-8d20-4bde9fe13439 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:37.704938 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fb99085e-380a-4e8e-8d20-4bde9fe13439 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:37.709630 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fb99085e-380a-4e8e-8d20-4bde9fe13439 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:37.710087 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fb99085e-380a-4e8e-8d20-4bde9fe13439 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:37.802565 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-fb99085e-380a-4e8e-8d20-4bde9fe13439 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] HTTP exception thrown: Instance 813b0cda-aa4a-4e8d-a4c7-2042b9415e81 could not be found. Jan 15 02:47:37.803891 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-fb99085e-380a-4e8e-8d20-4bde9fe13439 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Returning 404 to user: Instance 813b0cda-aa4a-4e8d-a4c7-2042b9415e81 could not be found. {{(pid=94111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:47:37.805312 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-fb99085e-380a-4e8e-8d20-4bde9fe13439 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81" status: 404 len: 111 microversion: 2.1 time: 0.137831 Jan 15 02:47:37.821431 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 437/834] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:47:37 2021] GET /compute/v2.1/servers/813b0cda-aa4a-4e8d-a4c7-2042b9415e81 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:47:39.133938 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3a29ed56-9c84-4360-b051-d01d93c3905a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:39.134504 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3a29ed56-9c84-4360-b051-d01d93c3905a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:39.143167 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a29ed56-9c84-4360-b051-d01d93c3905a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:39.143685 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a29ed56-9c84-4360-b051-d01d93c3905a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:39.144544 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a29ed56-9c84-4360-b051-d01d93c3905a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:39.145063 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a29ed56-9c84-4360-b051-d01d93c3905a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:39.200898 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-3a29ed56-9c84-4360-b051-d01d93c3905a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] HTTP exception thrown: Instance a8a86e56-4ee0-4098-98bb-7deac49ba1aa could not be found. Jan 15 02:47:39.201607 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3a29ed56-9c84-4360-b051-d01d93c3905a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Returning 404 to user: Instance a8a86e56-4ee0-4098-98bb-7deac49ba1aa could not be found. {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:47:39.202516 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3a29ed56-9c84-4360-b051-d01d93c3905a tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "DELETE /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 404 len: 111 microversion: 2.1 time: 0.078302 Jan 15 02:47:39.203191 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 398/835] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:47:39 2021] DELETE /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:47:39.217278 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-cbad1a5f-aa90-4293-b9cc-6e9933770dd4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:39.217961 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-cbad1a5f-aa90-4293-b9cc-6e9933770dd4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] [instance: a8a86e56-4ee0-4098-98bb-7deac49ba1aa] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:47:39.226700 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cbad1a5f-aa90-4293-b9cc-6e9933770dd4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:39.227210 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cbad1a5f-aa90-4293-b9cc-6e9933770dd4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:39.228068 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cbad1a5f-aa90-4293-b9cc-6e9933770dd4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:47:39.228562 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cbad1a5f-aa90-4293-b9cc-6e9933770dd4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:47:39.287531 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-cbad1a5f-aa90-4293-b9cc-6e9933770dd4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] HTTP exception thrown: Instance a8a86e56-4ee0-4098-98bb-7deac49ba1aa could not be found. Jan 15 02:47:39.288201 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-cbad1a5f-aa90-4293-b9cc-6e9933770dd4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] Returning 404 to user: Instance a8a86e56-4ee0-4098-98bb-7deac49ba1aa could not be found. {{(pid=94111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:47:39.289208 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-cbad1a5f-aa90-4293-b9cc-6e9933770dd4 tempest-AttachVolumeShelveTestJSON-349289058 tempest-AttachVolumeShelveTestJSON-349289058] 10.222.0.37 "GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa" status: 404 len: 111 microversion: 2.1 time: 0.081454 Jan 15 02:47:39.289820 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 438/836] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:47:39 2021] GET /compute/v2.1/servers/a8a86e56-4ee0-4098-98bb-7deac49ba1aa => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:47:50.098496 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d5f77d86-650a-48ac-92d3-c10600463cbd tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] Action: 'create', calling method: .version_select at 0x7f878e68b1e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1229854160"}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:47:50.256626 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5821d0cc-37a7-401b-a8e4-da558a881218 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Action: 'create', calling method: .version_select at 0x7f878e557158>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-875881786"}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:47:50.333732 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-5821d0cc-37a7-401b-a8e4-da558a881218 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Getting quotas for project a605fa30d830427db71d8178d5db456e. Resources: {'key_pairs'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:47:50.339107 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-5821d0cc-37a7-401b-a8e4-da558a881218 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Getting quotas for user 1e4528fe6b5a429688aeb5edbbf328e2 and project a605fa30d830427db71d8178d5db456e. Resources: {'key_pairs'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:47:50.781241 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-5821d0cc-37a7-401b-a8e4-da558a881218 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Getting quotas for project a605fa30d830427db71d8178d5db456e. Resources: {'key_pairs'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:47:50.787426 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-5821d0cc-37a7-401b-a8e4-da558a881218 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Getting quotas for user 1e4528fe6b5a429688aeb5edbbf328e2 and project a605fa30d830427db71d8178d5db456e. Resources: {'key_pairs'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:47:50.830152 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5821d0cc-37a7-401b-a8e4-da558a881218 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.864252 Jan 15 02:47:50.830835 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 439/837] 10.222.0.37 () {60 vars in 1148 bytes} [Fri Jan 15 02:47:49 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:47:50.862889 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-78ff3910-9723-4a54-a111-8747c4996460 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Action: 'create', calling method: .version_select at 0x7f878e772510>, body: {"security_group": {"name": "tempest-TestVolumeBootPattern-1449679234", "description": "tempest-TestVolumeBootPattern-1449679234 description"}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:47:51.006333 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d5f77d86-650a-48ac-92d3-c10600463cbd tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.284536 Jan 15 02:47:51.007958 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 399/838] 10.222.0.37 () {60 vars in 1145 bytes} [Fri Jan 15 02:47:49 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 1287 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 15 02:47:51.043324 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-53066a85-19d6-4825-b592-fe6ada1e1f75 tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] Calling method '.version_select at 0x7f878f1b9598>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:51.162380 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-53066a85-19d6-4825-b592-fe6ada1e1f75 tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] 10.222.0.37 "GET /compute/v2.1/os-volumes/48887a47-816d-495d-b9e1-e8e5061f16a8" status: 200 len: 345 microversion: 2.1 time: 0.143837 Jan 15 02:47:51.163015 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 400/839] 10.222.0.37 () {58 vars in 1235 bytes} [Fri Jan 15 02:47:51 2021] GET /compute/v2.1/os-volumes/48887a47-816d-495d-b9e1-e8e5061f16a8 => generated 345 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:47:51.232767 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-78ff3910-9723-4a54-a111-8747c4996460 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.395227 Jan 15 02:47:51.233922 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 440/840] 10.222.0.37 () {60 vars in 1170 bytes} [Fri Jan 15 02:47:50 2021] POST /compute/v2.1/os-security-groups => generated 251 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:47:51.250665 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a12f251e-0bc5-411b-8a81-0b324bdf383b tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Action: 'create', calling method: .version_select at 0x7f878e68b510>, body: {"security_group_rule": {"parent_group_id": "54edb4da-64e3-4a65-bef0-f963cdcf65f0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:47:51.487413 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a12f251e-0bc5-411b-8a81-0b324bdf383b tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.246002 Jan 15 02:47:51.488116 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 401/841] 10.222.0.37 () {60 vars in 1185 bytes} [Fri Jan 15 02:47:51 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:47:51.504847 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-486b604c-2bcd-4f3d-8ced-4fa1d4df6072 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Action: 'create', calling method: .version_select at 0x7f878e76b488>, body: {"security_group_rule": {"parent_group_id": "54edb4da-64e3-4a65-bef0-f963cdcf65f0", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:47:51.736446 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-486b604c-2bcd-4f3d-8ced-4fa1d4df6072 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.240699 Jan 15 02:47:51.737122 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 441/842] 10.222.0.37 () {60 vars in 1185 bytes} [Fri Jan 15 02:47:51 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:47:52.182088 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-739bb8d3-d40e-464a-b53f-1e4a26d3aaae tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] Calling method '.version_select at 0x7f878e7546a8>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:52.317413 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-739bb8d3-d40e-464a-b53f-1e4a26d3aaae tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] 10.222.0.37 "GET /compute/v2.1/os-volumes/48887a47-816d-495d-b9e1-e8e5061f16a8" status: 200 len: 346 microversion: 2.1 time: 0.143850 Jan 15 02:47:52.318999 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 402/843] 10.222.0.37 () {58 vars in 1235 bytes} [Fri Jan 15 02:47:52 2021] GET /compute/v2.1/os-volumes/48887a47-816d-495d-b9e1-e8e5061f16a8 => generated 346 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:47:52.340741 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-70bd1661-1198-404b-9b03-ebe34a637d2e tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] Action: 'create', calling method: .version_select at 0x7f8793c2f510>, body: {"snapshot": {"volume_id": "48887a47-816d-495d-b9e1-e8e5061f16a8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-281340390"}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:47:52.629474 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-70bd1661-1198-404b-9b03-ebe34a637d2e tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] 10.222.0.37 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.302540 Jan 15 02:47:52.630396 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 442/844] 10.222.0.37 () {60 vars in 1152 bytes} [Fri Jan 15 02:47:52 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:47:52.648655 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a3d7e09d-524a-44e2-9ebe-420dbd97bc8c tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] Calling method '.version_select at 0x7f878e754620>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:52.720619 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a3d7e09d-524a-44e2-9ebe-420dbd97bc8c tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] 10.222.0.37 "GET /compute/v2.1/os-snapshots/4b258461-5ece-4160-8680-27667d891af6" status: 200 len: 286 microversion: 2.1 time: 0.084023 Jan 15 02:47:52.721446 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 403/845] 10.222.0.37 () {58 vars in 1241 bytes} [Fri Jan 15 02:47:52 2021] GET /compute/v2.1/os-snapshots/4b258461-5ece-4160-8680-27667d891af6 => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:47:52.737496 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-05e310e3-3f5a-4a1f-8cec-1bf97e0d7469 tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] Calling method '.version_select at 0x7f878fb02268>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:52.832903 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-05e310e3-3f5a-4a1f-8cec-1bf97e0d7469 tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] 10.222.0.37 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.105011 Jan 15 02:47:52.833560 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 443/846] 10.222.0.37 () {58 vars in 1130 bytes} [Fri Jan 15 02:47:52 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:47:52.868059 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-88517161-f6d8-4c17-a9da-7beda5ec2140 tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] Calling method '.version_select at 0x7f878e7548c8>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:52.926904 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-88517161-f6d8-4c17-a9da-7beda5ec2140 tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] 10.222.0.37 "GET /compute/v2.1/os-snapshots/4b258461-5ece-4160-8680-27667d891af6" status: 200 len: 286 microversion: 2.1 time: 0.083922 Jan 15 02:47:52.927533 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 404/847] 10.222.0.37 () {58 vars in 1241 bytes} [Fri Jan 15 02:47:52 2021] GET /compute/v2.1/os-snapshots/4b258461-5ece-4160-8680-27667d891af6 => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:47:53.944960 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-156ac1d5-b7b9-4312-b3ad-e16f8de65eb4 tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] Calling method '.version_select at 0x7f8793c2d158>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:53.997883 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-156ac1d5-b7b9-4312-b3ad-e16f8de65eb4 tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] 10.222.0.37 "GET /compute/v2.1/os-snapshots/4b258461-5ece-4160-8680-27667d891af6" status: 200 len: 286 microversion: 2.1 time: 0.062851 Jan 15 02:47:53.998512 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 444/848] 10.222.0.37 () {58 vars in 1241 bytes} [Fri Jan 15 02:47:53 2021] GET /compute/v2.1/os-snapshots/4b258461-5ece-4160-8680-27667d891af6 => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:47:55.018283 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b68ad92e-4c64-480e-a4e4-78cf35baeadb tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] Calling method '.version_select at 0x7f878e68b7b8>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:55.071898 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b68ad92e-4c64-480e-a4e4-78cf35baeadb tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] 10.222.0.37 "GET /compute/v2.1/os-snapshots/4b258461-5ece-4160-8680-27667d891af6" status: 200 len: 286 microversion: 2.1 time: 0.064385 Jan 15 02:47:55.072540 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 405/849] 10.222.0.37 () {58 vars in 1241 bytes} [Fri Jan 15 02:47:55 2021] GET /compute/v2.1/os-snapshots/4b258461-5ece-4160-8680-27667d891af6 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:47:56.093215 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b7a695de-660a-40f2-b5f9-14bb245d7528 tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] Calling method '.version_select at 0x7f878fb022f0>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:56.153097 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b7a695de-660a-40f2-b5f9-14bb245d7528 tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] 10.222.0.37 "GET /compute/v2.1/os-snapshots/4b258461-5ece-4160-8680-27667d891af6" status: 200 len: 287 microversion: 2.1 time: 0.071125 Jan 15 02:47:56.154032 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 445/850] 10.222.0.37 () {58 vars in 1241 bytes} [Fri Jan 15 02:47:56 2021] GET /compute/v2.1/os-snapshots/4b258461-5ece-4160-8680-27667d891af6 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:47:56.172852 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f7209786-d6f3-4799-ab10-ab3ce20a2dd4 tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] Calling method '.version_select at 0x7f878e68b950>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:56.300159 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f7209786-d6f3-4799-ab10-ab3ce20a2dd4 tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] 10.222.0.37 "DELETE /compute/v2.1/os-snapshots/4b258461-5ece-4160-8680-27667d891af6" status: 202 len: 0 microversion: 2.1 time: 0.138011 Jan 15 02:47:56.300900 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 406/851] 10.222.0.37 () {58 vars in 1244 bytes} [Fri Jan 15 02:47:56 2021] DELETE /compute/v2.1/os-snapshots/4b258461-5ece-4160-8680-27667d891af6 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:47:56.317463 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1c169e45-0919-46a6-ad06-9de8d40527f5 tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] Calling method '.version_select at 0x7f8790387ea0>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:56.372720 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1c169e45-0919-46a6-ad06-9de8d40527f5 tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] 10.222.0.37 "GET /compute/v2.1/os-snapshots/4b258461-5ece-4160-8680-27667d891af6" status: 200 len: 286 microversion: 2.1 time: 0.065696 Jan 15 02:47:56.373402 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 446/852] 10.222.0.37 () {58 vars in 1241 bytes} [Fri Jan 15 02:47:56 2021] GET /compute/v2.1/os-snapshots/4b258461-5ece-4160-8680-27667d891af6 => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:47:57.394996 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2fa39269-0a52-455e-ab8d-1b68e6f02c5c tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] Calling method '.version_select at 0x7f878e7541e0>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:57.459632 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-2fa39269-0a52-455e-ab8d-1b68e6f02c5c tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] HTTP exception thrown: Snapshot 4b258461-5ece-4160-8680-27667d891af6 could not be found. Jan 15 02:47:57.460274 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2fa39269-0a52-455e-ab8d-1b68e6f02c5c tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] Returning 404 to user: Snapshot 4b258461-5ece-4160-8680-27667d891af6 could not be found. {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:47:57.461223 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2fa39269-0a52-455e-ab8d-1b68e6f02c5c tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] 10.222.0.37 "GET /compute/v2.1/os-snapshots/4b258461-5ece-4160-8680-27667d891af6" status: 404 len: 111 microversion: 2.1 time: 0.079043 Jan 15 02:47:57.462394 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 407/853] 10.222.0.37 () {58 vars in 1241 bytes} [Fri Jan 15 02:47:57 2021] GET /compute/v2.1/os-snapshots/4b258461-5ece-4160-8680-27667d891af6 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:47:57.478536 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a64f9133-0d1b-4f66-a697-8d2b62c85a21 tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] Calling method '.version_select at 0x7f878e76bf28>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:57.617214 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a64f9133-0d1b-4f66-a697-8d2b62c85a21 tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/48887a47-816d-495d-b9e1-e8e5061f16a8" status: 202 len: 0 microversion: 2.1 time: 0.149267 Jan 15 02:47:57.621723 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 447/854] 10.222.0.37 () {58 vars in 1238 bytes} [Fri Jan 15 02:47:57 2021] DELETE /compute/v2.1/os-volumes/48887a47-816d-495d-b9e1-e8e5061f16a8 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:47:57.644147 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9180efb6-2770-466b-aa49-fcb17c8547b2 tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] Calling method '.version_select at 0x7f878e68b510>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:57.796783 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9180efb6-2770-466b-aa49-fcb17c8547b2 tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] 10.222.0.37 "GET /compute/v2.1/os-volumes/48887a47-816d-495d-b9e1-e8e5061f16a8" status: 200 len: 345 microversion: 2.1 time: 0.172594 Jan 15 02:47:57.797618 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 408/855] 10.222.0.37 () {58 vars in 1235 bytes} [Fri Jan 15 02:47:57 2021] GET /compute/v2.1/os-volumes/48887a47-816d-495d-b9e1-e8e5061f16a8 => generated 345 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:47:58.816642 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-45936aab-41a5-469c-9d8a-ba1d4056a0bf tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] Calling method '.version_select at 0x7f878fb02158>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:58.890051 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-45936aab-41a5-469c-9d8a-ba1d4056a0bf tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] HTTP exception thrown: Volume 48887a47-816d-495d-b9e1-e8e5061f16a8 could not be found. Jan 15 02:47:58.890828 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-45936aab-41a5-469c-9d8a-ba1d4056a0bf tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] Returning 404 to user: Volume 48887a47-816d-495d-b9e1-e8e5061f16a8 could not be found. {{(pid=94111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:47:58.891804 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-45936aab-41a5-469c-9d8a-ba1d4056a0bf tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] 10.222.0.37 "GET /compute/v2.1/os-volumes/48887a47-816d-495d-b9e1-e8e5061f16a8" status: 404 len: 109 microversion: 2.1 time: 0.085476 Jan 15 02:47:58.892472 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 448/856] 10.222.0.37 () {58 vars in 1235 bytes} [Fri Jan 15 02:47:58 2021] GET /compute/v2.1/os-volumes/48887a47-816d-495d-b9e1-e8e5061f16a8 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 02:47:58.915641 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-172b7bdb-c28d-403c-b49d-361d3a2309de tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] Calling method '.version_select at 0x7f878e68bd90>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:58.986357 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-172b7bdb-c28d-403c-b49d-361d3a2309de tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] HTTP exception thrown: Volume 48887a47-816d-495d-b9e1-e8e5061f16a8 could not be found. Jan 15 02:47:58.987028 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-172b7bdb-c28d-403c-b49d-361d3a2309de tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] Returning 404 to user: Volume 48887a47-816d-495d-b9e1-e8e5061f16a8 could not be found. {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:47:58.987934 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-172b7bdb-c28d-403c-b49d-361d3a2309de tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/48887a47-816d-495d-b9e1-e8e5061f16a8" status: 404 len: 109 microversion: 2.1 time: 0.082806 Jan 15 02:47:58.988572 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 409/857] 10.222.0.37 () {58 vars in 1238 bytes} [Fri Jan 15 02:47:58 2021] DELETE /compute/v2.1/os-volumes/48887a47-816d-495d-b9e1-e8e5061f16a8 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:47:59.004638 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-8659c446-f05c-414c-b438-996f67cb4f10 tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] Calling method '.version_select at 0x7f878e76b6a8>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:47:59.078712 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-8659c446-f05c-414c-b438-996f67cb4f10 tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] HTTP exception thrown: Volume 48887a47-816d-495d-b9e1-e8e5061f16a8 could not be found. Jan 15 02:47:59.079466 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-8659c446-f05c-414c-b438-996f67cb4f10 tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] Returning 404 to user: Volume 48887a47-816d-495d-b9e1-e8e5061f16a8 could not be found. {{(pid=94111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:47:59.080487 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-8659c446-f05c-414c-b438-996f67cb4f10 tempest-VolumesSnapshotsTestJSON-461852470 tempest-VolumesSnapshotsTestJSON-461852470] 10.222.0.37 "GET /compute/v2.1/os-volumes/48887a47-816d-495d-b9e1-e8e5061f16a8" status: 404 len: 109 microversion: 2.1 time: 0.086934 Jan 15 02:47:59.083536 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 449/858] 10.222.0.37 () {58 vars in 1235 bytes} [Fri Jan 15 02:47:58 2021] GET /compute/v2.1/os-volumes/48887a47-816d-495d-b9e1-e8e5061f16a8 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:48:01.788252 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f5cbcc4b-5753-44f5-911a-037e9af2c3e4 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '.version_select at 0x7f878e6257b8>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:02.387371 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f5cbcc4b-5753-44f5-911a-037e9af2c3e4 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:02.397996 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f5cbcc4b-5753-44f5-911a-037e9af2c3e4 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:02.398735 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f5cbcc4b-5753-44f5-911a-037e9af2c3e4 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:02.400024 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f5cbcc4b-5753-44f5-911a-037e9af2c3e4 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:02.400556 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f5cbcc4b-5753-44f5-911a-037e9af2c3e4 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:02.474205 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f5cbcc4b-5753-44f5-911a-037e9af2c3e4 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Acquired lock "refresh_cache-19d658a3-85b8-4130-b672-9843892a6fa5" {{(pid=94112) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Jan 15 02:48:04.817464 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-f5cbcc4b-5753-44f5-911a-037e9af2c3e4 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Building network info cache for instance {{(pid=94112) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1831}} Jan 15 02:48:04.828693 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-08b0093b-9839-4e4d-9176-20bc9726761f req-44904e84-b119-4b26-a6db-a0f6cba39efb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19d658a3-85b8-4130-b672-9843892a6fa5", "tag": "f6b12a20-2846-4e92-bcbd-958c13c5e899"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:48:04.841659 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:48:04.841659 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:48:04.854662 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-08b0093b-9839-4e4d-9176-20bc9726761f req-44904e84-b119-4b26-a6db-a0f6cba39efb service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:04.855724 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-08b0093b-9839-4e4d-9176-20bc9726761f req-44904e84-b119-4b26-a6db-a0f6cba39efb service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:04.876502 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-08b0093b-9839-4e4d-9176-20bc9726761f req-44904e84-b119-4b26-a6db-a0f6cba39efb service nova] Creating event network-changed:f6b12a20-2846-4e92-bcbd-958c13c5e899 for instance 19d658a3-85b8-4130-b672-9843892a6fa5 on hv-cinder-76330 Jan 15 02:48:04.891800 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-08b0093b-9839-4e4d-9176-20bc9726761f req-44904e84-b119-4b26-a6db-a0f6cba39efb service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071021 Jan 15 02:48:04.892514 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 450/859] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:48:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:48:05.784608 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-f5cbcc4b-5753-44f5-911a-037e9af2c3e4 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Updating instance_info_cache with network_info: [{"id": "f6b12a20-2846-4e92-bcbd-958c13c5e899", "address": "fa:16:3e:0e:44:c0", "network": {"id": "521e2a79-be5d-4fa6-8eb8-43b75fdf9d47", "bridge": "br-int", "label": "tempest-TestShelveInstance-1791209952-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "813af52eb922416fbfc79ce6c132a7d2", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapf6b12a20-28", "ovs_interfaceid": "f6b12a20-2846-4e92-bcbd-958c13c5e899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94112) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Jan 15 02:48:05.802533 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f5cbcc4b-5753-44f5-911a-037e9af2c3e4 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Releasing lock "refresh_cache-19d658a3-85b8-4130-b672-9843892a6fa5" {{(pid=94112) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Jan 15 02:48:05.803935 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f5cbcc4b-5753-44f5-911a-037e9af2c3e4 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "DELETE /compute/v2.1/os-floating-ips/543273c4-ea4b-4d21-a525-bbbedb4dfa76" status: 202 len: 0 microversion: 2.1 time: 4.297993 Jan 15 02:48:05.804818 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 410/860] 10.222.0.37 () {58 vars in 1253 bytes} [Fri Jan 15 02:48:01 2021] DELETE /compute/v2.1/os-floating-ips/543273c4-ea4b-4d21-a525-bbbedb4dfa76 => generated 0 bytes in 4300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:48:05.821857 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5ca542c8-62ee-4a8d-9b46-f5db899ab183 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:05.822503 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5ca542c8-62ee-4a8d-9b46-f5db899ab183 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:05.833887 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5ca542c8-62ee-4a8d-9b46-f5db899ab183 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:05.834459 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5ca542c8-62ee-4a8d-9b46-f5db899ab183 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:05.835402 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5ca542c8-62ee-4a8d-9b46-f5db899ab183 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:05.835885 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5ca542c8-62ee-4a8d-9b46-f5db899ab183 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:05.919642 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5ca542c8-62ee-4a8d-9b46-f5db899ab183 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Going to try to terminate instance {{(pid=94111) delete /opt/stack/nova/nova/compute/api.py:2535}} Jan 15 02:48:06.084251 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5ca542c8-62ee-4a8d-9b46-f5db899ab183 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "DELETE /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 204 len: 0 microversion: 2.1 time: 0.271289 Jan 15 02:48:06.085599 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 451/861] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:48:05 2021] DELETE /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 02:48:06.100437 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a8c05041-0b72-48e7-8572-2b7d072f8636 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:06.101317 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a8c05041-0b72-48e7-8572-2b7d072f8636 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:06.111029 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a8c05041-0b72-48e7-8572-2b7d072f8636 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:06.111722 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a8c05041-0b72-48e7-8572-2b7d072f8636 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:06.112735 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a8c05041-0b72-48e7-8572-2b7d072f8636 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:06.113400 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a8c05041-0b72-48e7-8572-2b7d072f8636 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:06.433669 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a8c05041-0b72-48e7-8572-2b7d072f8636 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:06.444250 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a8c05041-0b72-48e7-8572-2b7d072f8636 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1455 microversion: 2.1 time: 0.353903 Jan 15 02:48:06.445091 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 411/862] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:06 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1455 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:07.483370 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4ab63abe-3c4f-49ae-b78f-e15b18971a01 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:07.485739 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4ab63abe-3c4f-49ae-b78f-e15b18971a01 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:07.509114 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4ab63abe-3c4f-49ae-b78f-e15b18971a01 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:07.510007 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4ab63abe-3c4f-49ae-b78f-e15b18971a01 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:07.511571 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4ab63abe-3c4f-49ae-b78f-e15b18971a01 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:07.521486 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4ab63abe-3c4f-49ae-b78f-e15b18971a01 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:07.927981 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4ab63abe-3c4f-49ae-b78f-e15b18971a01 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:07.944833 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4ab63abe-3c4f-49ae-b78f-e15b18971a01 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1455 microversion: 2.1 time: 0.484063 Jan 15 02:48:07.945698 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 452/863] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:07 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1455 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:08.971451 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1e32d35d-d3c3-4036-81ee-4a6cf7323224 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:08.972130 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1e32d35d-d3c3-4036-81ee-4a6cf7323224 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:08.990675 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1e32d35d-d3c3-4036-81ee-4a6cf7323224 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:08.990675 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1e32d35d-d3c3-4036-81ee-4a6cf7323224 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:08.990675 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1e32d35d-d3c3-4036-81ee-4a6cf7323224 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:08.990675 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1e32d35d-d3c3-4036-81ee-4a6cf7323224 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:09.298283 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1e32d35d-d3c3-4036-81ee-4a6cf7323224 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:09.308864 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1e32d35d-d3c3-4036-81ee-4a6cf7323224 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1455 microversion: 2.1 time: 0.348650 Jan 15 02:48:09.309652 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 412/864] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:08 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1455 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:10.334613 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c141ec4a-3bcf-4e14-906e-59a37337b72e tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:10.335456 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c141ec4a-3bcf-4e14-906e-59a37337b72e tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:10.344809 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c141ec4a-3bcf-4e14-906e-59a37337b72e tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:10.345456 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c141ec4a-3bcf-4e14-906e-59a37337b72e tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:10.346177 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c141ec4a-3bcf-4e14-906e-59a37337b72e tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:10.346824 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c141ec4a-3bcf-4e14-906e-59a37337b72e tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:10.703075 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c141ec4a-3bcf-4e14-906e-59a37337b72e tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:10.712685 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c141ec4a-3bcf-4e14-906e-59a37337b72e tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1455 microversion: 2.1 time: 0.387674 Jan 15 02:48:10.713531 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 453/865] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:10 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1455 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:11.739035 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c2988089-6be8-44be-82fa-fc75a94b4077 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:11.739780 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c2988089-6be8-44be-82fa-fc75a94b4077 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:11.748693 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c2988089-6be8-44be-82fa-fc75a94b4077 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:11.749574 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c2988089-6be8-44be-82fa-fc75a94b4077 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:11.750547 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c2988089-6be8-44be-82fa-fc75a94b4077 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:11.751187 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c2988089-6be8-44be-82fa-fc75a94b4077 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:12.055430 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c2988089-6be8-44be-82fa-fc75a94b4077 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:12.067114 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c2988089-6be8-44be-82fa-fc75a94b4077 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1455 microversion: 2.1 time: 0.338711 Jan 15 02:48:12.067875 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 413/866] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:11 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1455 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:13.101842 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-91b3d833-73bc-4690-829a-62a56a22045d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:13.102633 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-91b3d833-73bc-4690-829a-62a56a22045d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:13.125996 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-7624e88a-7794-4931-bf0e-4d91b796bd3b req-78704a80-9db8-4cb9-8b15-228d50645339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d658a3-85b8-4130-b672-9843892a6fa5", "name": "network-vif-deleted", "tag": "f6b12a20-2846-4e92-bcbd-958c13c5e899"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:48:13.134601 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-91b3d833-73bc-4690-829a-62a56a22045d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:13.135336 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-91b3d833-73bc-4690-829a-62a56a22045d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:13.138262 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-91b3d833-73bc-4690-829a-62a56a22045d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:13.138890 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-91b3d833-73bc-4690-829a-62a56a22045d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:13.147840 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:48:13.147840 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:48:13.168680 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-7624e88a-7794-4931-bf0e-4d91b796bd3b req-78704a80-9db8-4cb9-8b15-228d50645339 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:13.172966 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-7624e88a-7794-4931-bf0e-4d91b796bd3b req-78704a80-9db8-4cb9-8b15-228d50645339 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:13.210593 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-7624e88a-7794-4931-bf0e-4d91b796bd3b req-78704a80-9db8-4cb9-8b15-228d50645339 service nova] Creating event network-vif-deleted:f6b12a20-2846-4e92-bcbd-958c13c5e899 for instance 19d658a3-85b8-4130-b672-9843892a6fa5 on hv-cinder-76330 Jan 15 02:48:13.219057 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-7624e88a-7794-4931-bf0e-4d91b796bd3b req-78704a80-9db8-4cb9-8b15-228d50645339 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106283 Jan 15 02:48:13.221414 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 414/867] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:48:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:48:13.354468 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-91b3d833-73bc-4690-829a-62a56a22045d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:13.365554 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-91b3d833-73bc-4690-829a-62a56a22045d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1220 microversion: 2.1 time: 0.282385 Jan 15 02:48:13.366327 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 454/868] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:13 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1220 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:14.392112 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c7c8149b-5679-40b5-803c-7936e9e049bd tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:14.392730 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c7c8149b-5679-40b5-803c-7936e9e049bd tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:14.401464 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c7c8149b-5679-40b5-803c-7936e9e049bd tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:14.401958 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c7c8149b-5679-40b5-803c-7936e9e049bd tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:14.402803 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c7c8149b-5679-40b5-803c-7936e9e049bd tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:14.403290 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c7c8149b-5679-40b5-803c-7936e9e049bd tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:14.492627 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c7c8149b-5679-40b5-803c-7936e9e049bd tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:14.493501 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c7c8149b-5679-40b5-803c-7936e9e049bd tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:14.494112 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.objects.instance [None req-c7c8149b-5679-40b5-803c-7936e9e049bd tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lazy-loading 'fault' on Instance uuid 19d658a3-85b8-4130-b672-9843892a6fa5 {{(pid=94112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Jan 15 02:48:14.621454 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c7c8149b-5679-40b5-803c-7936e9e049bd tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660cbc87b9f42a2b5fdc179d815d734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813af52eb922416fbfc79ce6c132a7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:14.646558 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c7c8149b-5679-40b5-803c-7936e9e049bd tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 200 len: 1225 microversion: 2.1 time: 0.264683 Jan 15 02:48:14.647575 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 415/869] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:14 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 1225 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:15.673373 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3d8ceb15-dc97-4942-97cc-ee39414f1cff tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:15.674063 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3d8ceb15-dc97-4942-97cc-ee39414f1cff tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] [instance: 19d658a3-85b8-4130-b672-9843892a6fa5] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:15.682228 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3d8ceb15-dc97-4942-97cc-ee39414f1cff tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:15.682733 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3d8ceb15-dc97-4942-97cc-ee39414f1cff tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:15.683581 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3d8ceb15-dc97-4942-97cc-ee39414f1cff tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:15.684066 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3d8ceb15-dc97-4942-97cc-ee39414f1cff tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:15.740011 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-3d8ceb15-dc97-4942-97cc-ee39414f1cff tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] HTTP exception thrown: Instance 19d658a3-85b8-4130-b672-9843892a6fa5 could not be found. Jan 15 02:48:15.740684 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3d8ceb15-dc97-4942-97cc-ee39414f1cff tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Returning 404 to user: Instance 19d658a3-85b8-4130-b672-9843892a6fa5 could not be found. {{(pid=94111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:48:15.741622 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3d8ceb15-dc97-4942-97cc-ee39414f1cff tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5" status: 404 len: 111 microversion: 2.1 time: 0.077870 Jan 15 02:48:15.742247 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 455/870] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:15 2021] GET /compute/v2.1/servers/19d658a3-85b8-4130-b672-9843892a6fa5 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:48:15.757267 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-87562bd7-6eb2-4a10-a6ef-1b5d3a769801 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '.version_select at 0x7f878e7549d8>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:16.038757 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-87562bd7-6eb2-4a10-a6ef-1b5d3a769801 tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "DELETE /compute/v2.1/os-security-groups/f690da1b-6dd1-4063-be7c-461a7981d18d" status: 202 len: 0 microversion: 2.1 time: 0.290997 Jan 15 02:48:16.040079 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 416/871] 10.222.0.37 () {58 vars in 1262 bytes} [Fri Jan 15 02:48:15 2021] DELETE /compute/v2.1/os-security-groups/f690da1b-6dd1-4063-be7c-461a7981d18d => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:48:16.056834 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4eadaf35-0a67-4135-9756-7004758d168d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] Calling method '.version_select at 0x7f879037db70>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:16.082891 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4eadaf35-0a67-4135-9756-7004758d168d tempest-TestShelveInstance-1172731177 tempest-TestShelveInstance-1172731177] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2069070189" status: 202 len: 0 microversion: 2.1 time: 0.037326 Jan 15 02:48:16.083532 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 456/872] 10.222.0.37 () {58 vars in 1244 bytes} [Fri Jan 15 02:48:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2069070189 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:48:16.486495 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-123c8e87-ee88-4759-abc8-8117289d1c52 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-253334516", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-875881786", "security_groups": [{"name": "tempest-TestVolumeBootPattern-1449679234"}], "block_device_mapping_v2": [{"uuid": "b9457018-0724-41eb-9e9c-16d3aee314b0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "66972a8b-9a9e-409f-92ab-ee571d05c923"}]}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:48:16.719407 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-123c8e87-ee88-4759-abc8-8117289d1c52 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] validate_networks() for [('66972a8b-9a9e-409f-92ab-ee571d05c923', None, None, None)] {{(pid=94112) validate_networks /opt/stack/nova/nova/network/neutron.py:2340}} Jan 15 02:48:17.470535 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-123c8e87-ee88-4759-abc8-8117289d1c52 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Flavor limits 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 02:48:17.471117 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-123c8e87-ee88-4759-abc8-8117289d1c52 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Image limits 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Jan 15 02:48:17.471850 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-123c8e87-ee88-4759-abc8-8117289d1c52 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Flavor pref 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 02:48:17.472378 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-123c8e87-ee88-4759-abc8-8117289d1c52 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Image pref 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Jan 15 02:48:17.472908 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-123c8e87-ee88-4759-abc8-8117289d1c52 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Jan 15 02:48:17.485731 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-123c8e87-ee88-4759-abc8-8117289d1c52 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:17.486395 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-123c8e87-ee88-4759-abc8-8117289d1c52 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:17.487415 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-123c8e87-ee88-4759-abc8-8117289d1c52 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:17.488021 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-123c8e87-ee88-4759-abc8-8117289d1c52 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:17.517771 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-123c8e87-ee88-4759-abc8-8117289d1c52 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Getting quotas for project a605fa30d830427db71d8178d5db456e. Resources: {'ram', 'instances', 'cores'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:48:17.523240 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-123c8e87-ee88-4759-abc8-8117289d1c52 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Getting quotas for user 1e4528fe6b5a429688aeb5edbbf328e2 and project a605fa30d830427db71d8178d5db456e. Resources: {'ram', 'instances', 'cores'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:48:17.684507 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-123c8e87-ee88-4759-abc8-8117289d1c52 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Going to run 1 instances... {{(pid=94112) _provision_instances /opt/stack/nova/nova/compute/api.py:1263}} Jan 15 02:48:17.688064 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-123c8e87-ee88-4759-abc8-8117289d1c52 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b9457018-0724-41eb-9e9c-16d3aee314b0',volume_size=None,volume_type=None)] {{(pid=94112) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1661}} Jan 15 02:48:17.929390 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-123c8e87-ee88-4759-abc8-8117289d1c52 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 413 microversion: 2.1 time: 1.453781 Jan 15 02:48:17.930359 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 417/873] 10.222.0.37 () {60 vars in 1137 bytes} [Fri Jan 15 02:48:16 2021] POST /compute/v2.1/servers => generated 413 bytes in 1455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 02:48:17.947445 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6f41ce6e-6c39-4b7c-a4b4-d22849f1a40b tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:17.948138 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6f41ce6e-6c39-4b7c-a4b4-d22849f1a40b tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:18.106400 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6f41ce6e-6c39-4b7c-a4b4-d22849f1a40b tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:18.115953 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6f41ce6e-6c39-4b7c-a4b4-d22849f1a40b tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 200 len: 1093 microversion: 2.1 time: 0.177821 Jan 15 02:48:18.116570 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 457/874] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:17 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 1093 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:48:19.141219 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-09a82398-f73f-42b5-9e41-6ac0bb9773d1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:19.141878 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-09a82398-f73f-42b5-9e41-6ac0bb9773d1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:19.167562 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-09a82398-f73f-42b5-9e41-6ac0bb9773d1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:19.168468 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-09a82398-f73f-42b5-9e41-6ac0bb9773d1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:19.169432 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-09a82398-f73f-42b5-9e41-6ac0bb9773d1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:19.169982 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-09a82398-f73f-42b5-9e41-6ac0bb9773d1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:19.397078 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-09a82398-f73f-42b5-9e41-6ac0bb9773d1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:19.414672 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-09a82398-f73f-42b5-9e41-6ac0bb9773d1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 200 len: 1199 microversion: 2.1 time: 0.283563 Jan 15 02:48:19.415689 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 418/875] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:19 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 1199 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:20.443910 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d743c936-82a5-4448-b98d-00d5be6c50a8 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:20.445447 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d743c936-82a5-4448-b98d-00d5be6c50a8 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:20.456726 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d743c936-82a5-4448-b98d-00d5be6c50a8 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:20.457567 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d743c936-82a5-4448-b98d-00d5be6c50a8 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:20.458848 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d743c936-82a5-4448-b98d-00d5be6c50a8 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:20.459543 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d743c936-82a5-4448-b98d-00d5be6c50a8 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:20.644272 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d743c936-82a5-4448-b98d-00d5be6c50a8 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:20.663245 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d743c936-82a5-4448-b98d-00d5be6c50a8 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 200 len: 1209 microversion: 2.1 time: 0.232187 Jan 15 02:48:20.664153 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 458/876] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:20 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 1209 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:21.688560 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-58591e2d-8451-4e14-a655-235f560e667f tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:21.689263 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-58591e2d-8451-4e14-a655-235f560e667f tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:21.697403 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-58591e2d-8451-4e14-a655-235f560e667f tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:21.697911 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-58591e2d-8451-4e14-a655-235f560e667f tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:21.698749 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-58591e2d-8451-4e14-a655-235f560e667f tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:21.699237 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-58591e2d-8451-4e14-a655-235f560e667f tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:22.010883 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-58591e2d-8451-4e14-a655-235f560e667f tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:22.021588 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-58591e2d-8451-4e14-a655-235f560e667f tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 200 len: 1209 microversion: 2.1 time: 0.341948 Jan 15 02:48:22.021588 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 419/877] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:21 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 1209 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:23.065780 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2091911b-ffcc-418e-b1af-30a412a07762 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:23.066453 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2091911b-ffcc-418e-b1af-30a412a07762 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:23.075336 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2091911b-ffcc-418e-b1af-30a412a07762 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:23.076403 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2091911b-ffcc-418e-b1af-30a412a07762 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:23.078065 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2091911b-ffcc-418e-b1af-30a412a07762 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:23.078587 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2091911b-ffcc-418e-b1af-30a412a07762 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:23.636250 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-2091911b-ffcc-418e-b1af-30a412a07762 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:23.655422 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2091911b-ffcc-418e-b1af-30a412a07762 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 200 len: 1284 microversion: 2.1 time: 0.616413 Jan 15 02:48:23.655970 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 459/878] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:23 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 1284 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:24.697290 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-411b2ffb-31c9-49b4-bf28-edef62aaa64f tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:24.698626 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-411b2ffb-31c9-49b4-bf28-edef62aaa64f tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:24.715273 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-411b2ffb-31c9-49b4-bf28-edef62aaa64f tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:24.716076 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-411b2ffb-31c9-49b4-bf28-edef62aaa64f tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:24.718700 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-411b2ffb-31c9-49b4-bf28-edef62aaa64f tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:24.720204 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-411b2ffb-31c9-49b4-bf28-edef62aaa64f tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:24.955640 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-bf4d531a-7524-4461-8fb0-14e5bc7899f6 req-00e41216-4925-46b5-92ee-d8df8e74a212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "883232af-b44d-4667-a346-099139fb27ea", "tag": "0e3ce2a7-84eb-48d9-9129-f341c2f9f662"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:48:24.972850 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:48:24.972850 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:48:24.983657 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-bf4d531a-7524-4461-8fb0-14e5bc7899f6 req-00e41216-4925-46b5-92ee-d8df8e74a212 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:24.984251 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-bf4d531a-7524-4461-8fb0-14e5bc7899f6 req-00e41216-4925-46b5-92ee-d8df8e74a212 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:25.005684 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-bf4d531a-7524-4461-8fb0-14e5bc7899f6 req-00e41216-4925-46b5-92ee-d8df8e74a212 service nova] Creating event network-changed:0e3ce2a7-84eb-48d9-9129-f341c2f9f662 for instance 883232af-b44d-4667-a346-099139fb27ea on hv-cinder-76330 Jan 15 02:48:25.011202 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-bf4d531a-7524-4461-8fb0-14e5bc7899f6 req-00e41216-4925-46b5-92ee-d8df8e74a212 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066556 Jan 15 02:48:25.011948 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 460/879] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:48:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:48:25.276486 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-411b2ffb-31c9-49b4-bf28-edef62aaa64f tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:25.287541 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-411b2ffb-31c9-49b4-bf28-edef62aaa64f tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 200 len: 1284 microversion: 2.1 time: 0.613280 Jan 15 02:48:25.288288 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 420/880] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:24 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 1284 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:26.314539 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-8f62e923-7dd1-4710-8c7e-6afd956681f3 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:26.315239 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8f62e923-7dd1-4710-8c7e-6afd956681f3 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:26.324206 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8f62e923-7dd1-4710-8c7e-6afd956681f3 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:26.324717 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8f62e923-7dd1-4710-8c7e-6afd956681f3 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:26.325726 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8f62e923-7dd1-4710-8c7e-6afd956681f3 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:26.326531 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8f62e923-7dd1-4710-8c7e-6afd956681f3 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:27.003740 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-8f62e923-7dd1-4710-8c7e-6afd956681f3 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:27.015059 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-8f62e923-7dd1-4710-8c7e-6afd956681f3 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 200 len: 1284 microversion: 2.1 time: 0.711729 Jan 15 02:48:27.020822 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 461/881] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:26 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 1284 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:28.051025 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-6dc6c72e-b505-4589-9669-7bc5593cd440 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:28.051589 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-6dc6c72e-b505-4589-9669-7bc5593cd440 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:28.059809 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6dc6c72e-b505-4589-9669-7bc5593cd440 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:28.061176 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6dc6c72e-b505-4589-9669-7bc5593cd440 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:28.062146 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6dc6c72e-b505-4589-9669-7bc5593cd440 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:28.062652 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-6dc6c72e-b505-4589-9669-7bc5593cd440 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:28.361402 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-6dc6c72e-b505-4589-9669-7bc5593cd440 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:28.380983 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-6dc6c72e-b505-4589-9669-7bc5593cd440 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 200 len: 1272 microversion: 2.1 time: 0.340378 Jan 15 02:48:28.382159 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 421/882] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:28 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 1272 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:29.418557 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-936ecd20-adca-4b66-b1ba-bf45593e62e6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:29.420497 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-936ecd20-adca-4b66-b1ba-bf45593e62e6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:29.433240 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-936ecd20-adca-4b66-b1ba-bf45593e62e6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:29.433801 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-936ecd20-adca-4b66-b1ba-bf45593e62e6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:29.434906 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-936ecd20-adca-4b66-b1ba-bf45593e62e6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:29.436210 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-936ecd20-adca-4b66-b1ba-bf45593e62e6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:29.868934 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-936ecd20-adca-4b66-b1ba-bf45593e62e6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:29.884007 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-936ecd20-adca-4b66-b1ba-bf45593e62e6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 200 len: 1272 microversion: 2.1 time: 0.476703 Jan 15 02:48:29.884543 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 462/883] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:29 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 1272 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:30.909802 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-fdc62377-b51f-4703-8eff-60f716b659c8 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:30.910484 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-fdc62377-b51f-4703-8eff-60f716b659c8 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:30.918887 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fdc62377-b51f-4703-8eff-60f716b659c8 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:30.920087 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fdc62377-b51f-4703-8eff-60f716b659c8 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:30.920876 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fdc62377-b51f-4703-8eff-60f716b659c8 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:30.921879 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fdc62377-b51f-4703-8eff-60f716b659c8 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:31.379818 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-fdc62377-b51f-4703-8eff-60f716b659c8 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:31.406528 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-fdc62377-b51f-4703-8eff-60f716b659c8 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 200 len: 1272 microversion: 2.1 time: 0.506071 Jan 15 02:48:31.418896 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 422/884] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:30 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 1272 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:32.442773 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c7903de7-1875-4de2-b32e-63817e82bb24 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:32.443584 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c7903de7-1875-4de2-b32e-63817e82bb24 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:32.453315 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c7903de7-1875-4de2-b32e-63817e82bb24 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:32.453994 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c7903de7-1875-4de2-b32e-63817e82bb24 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:32.455004 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c7903de7-1875-4de2-b32e-63817e82bb24 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:32.455573 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c7903de7-1875-4de2-b32e-63817e82bb24 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:33.035857 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c7903de7-1875-4de2-b32e-63817e82bb24 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:33.059438 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c7903de7-1875-4de2-b32e-63817e82bb24 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 200 len: 1272 microversion: 2.1 time: 0.626674 Jan 15 02:48:33.061272 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 463/885] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:32 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 1272 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:34.087966 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7d5e2c94-60f8-4b33-bbca-b513be5b6e10 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:34.089299 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-7d5e2c94-60f8-4b33-bbca-b513be5b6e10 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:34.098309 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7d5e2c94-60f8-4b33-bbca-b513be5b6e10 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:34.098819 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7d5e2c94-60f8-4b33-bbca-b513be5b6e10 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:34.099687 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7d5e2c94-60f8-4b33-bbca-b513be5b6e10 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:34.100182 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7d5e2c94-60f8-4b33-bbca-b513be5b6e10 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:34.703985 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-7d5e2c94-60f8-4b33-bbca-b513be5b6e10 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:34.714994 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-7d5e2c94-60f8-4b33-bbca-b513be5b6e10 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 200 len: 1272 microversion: 2.1 time: 0.639126 Jan 15 02:48:34.715601 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 423/886] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:34 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 1272 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:35.741332 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ba5ab0cb-08a1-4638-b539-7a88a8d51bbe tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:35.742360 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ba5ab0cb-08a1-4638-b539-7a88a8d51bbe tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:35.752492 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ba5ab0cb-08a1-4638-b539-7a88a8d51bbe tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:35.753143 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ba5ab0cb-08a1-4638-b539-7a88a8d51bbe tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:35.754578 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ba5ab0cb-08a1-4638-b539-7a88a8d51bbe tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:35.755091 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ba5ab0cb-08a1-4638-b539-7a88a8d51bbe tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:36.031816 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-ba5ab0cb-08a1-4638-b539-7a88a8d51bbe tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:36.043354 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ba5ab0cb-08a1-4638-b539-7a88a8d51bbe tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 200 len: 1272 microversion: 2.1 time: 0.311988 Jan 15 02:48:36.045033 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 464/887] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:35 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 1272 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:37.067652 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b5b28aaf-1e7e-4ea9-83fc-f78ea2e08a31 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:37.068328 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b5b28aaf-1e7e-4ea9-83fc-f78ea2e08a31 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:37.078090 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b5b28aaf-1e7e-4ea9-83fc-f78ea2e08a31 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:37.078599 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b5b28aaf-1e7e-4ea9-83fc-f78ea2e08a31 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:37.079461 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b5b28aaf-1e7e-4ea9-83fc-f78ea2e08a31 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:37.079948 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b5b28aaf-1e7e-4ea9-83fc-f78ea2e08a31 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:37.352994 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b5b28aaf-1e7e-4ea9-83fc-f78ea2e08a31 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:37.363988 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b5b28aaf-1e7e-4ea9-83fc-f78ea2e08a31 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 200 len: 1272 microversion: 2.1 time: 0.305587 Jan 15 02:48:37.363988 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 424/888] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:37 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 1272 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:38.387416 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-46afd0dc-c76c-4927-ac45-666155fd450f tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:38.388619 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-46afd0dc-c76c-4927-ac45-666155fd450f tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:38.396541 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-46afd0dc-c76c-4927-ac45-666155fd450f tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:38.397075 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-46afd0dc-c76c-4927-ac45-666155fd450f tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:38.397927 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-46afd0dc-c76c-4927-ac45-666155fd450f tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:38.398419 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-46afd0dc-c76c-4927-ac45-666155fd450f tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:38.910310 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-46afd0dc-c76c-4927-ac45-666155fd450f tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:38.920053 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-46afd0dc-c76c-4927-ac45-666155fd450f tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 200 len: 1272 microversion: 2.1 time: 0.541821 Jan 15 02:48:38.920722 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 465/889] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:38 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 1272 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:39.945087 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d20c6d36-2a53-4ea3-a5b3-36f9f5e7bcaf tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:39.945673 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d20c6d36-2a53-4ea3-a5b3-36f9f5e7bcaf tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:39.953883 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d20c6d36-2a53-4ea3-a5b3-36f9f5e7bcaf tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:39.954385 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d20c6d36-2a53-4ea3-a5b3-36f9f5e7bcaf tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:39.955227 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d20c6d36-2a53-4ea3-a5b3-36f9f5e7bcaf tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:39.955710 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d20c6d36-2a53-4ea3-a5b3-36f9f5e7bcaf tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:40.210906 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d20c6d36-2a53-4ea3-a5b3-36f9f5e7bcaf tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:40.222190 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d20c6d36-2a53-4ea3-a5b3-36f9f5e7bcaf tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 200 len: 1272 microversion: 2.1 time: 0.287271 Jan 15 02:48:40.222910 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 425/890] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:39 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 1272 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:41.248938 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-27b3e1ed-6db4-4bae-b23b-5620c0ba51d4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:41.249733 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-27b3e1ed-6db4-4bae-b23b-5620c0ba51d4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:41.258367 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-27b3e1ed-6db4-4bae-b23b-5620c0ba51d4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:41.259164 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-27b3e1ed-6db4-4bae-b23b-5620c0ba51d4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:41.260133 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-27b3e1ed-6db4-4bae-b23b-5620c0ba51d4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:41.260914 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-27b3e1ed-6db4-4bae-b23b-5620c0ba51d4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:41.534869 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-27b3e1ed-6db4-4bae-b23b-5620c0ba51d4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:41.544581 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-27b3e1ed-6db4-4bae-b23b-5620c0ba51d4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 200 len: 1272 microversion: 2.1 time: 0.305567 Jan 15 02:48:41.545335 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 466/891] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:41 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 1272 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:42.353508 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-9727fafd-fb1a-4394-b0de-20c09f355bd3 req-58696536-0c70-4dee-a728-d4e30be64c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883232af-b44d-4667-a346-099139fb27ea", "name": "network-vif-plugged", "status": "completed", "tag": "0e3ce2a7-84eb-48d9-9129-f341c2f9f662"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:48:42.362254 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:48:42.362254 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:48:42.372874 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-9727fafd-fb1a-4394-b0de-20c09f355bd3 req-58696536-0c70-4dee-a728-d4e30be64c82 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:42.373660 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-9727fafd-fb1a-4394-b0de-20c09f355bd3 req-58696536-0c70-4dee-a728-d4e30be64c82 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:42.394831 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-9727fafd-fb1a-4394-b0de-20c09f355bd3 req-58696536-0c70-4dee-a728-d4e30be64c82 service nova] Creating event network-vif-plugged:0e3ce2a7-84eb-48d9-9129-f341c2f9f662 for instance 883232af-b44d-4667-a346-099139fb27ea on hv-cinder-76330 Jan 15 02:48:42.400449 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-9727fafd-fb1a-4394-b0de-20c09f355bd3 req-58696536-0c70-4dee-a728-d4e30be64c82 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064179 Jan 15 02:48:42.401468 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 426/892] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:48:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:48:42.569375 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-31fa7df6-21c9-4c46-aebf-fb177ed0dbbe tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:42.570314 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-31fa7df6-21c9-4c46-aebf-fb177ed0dbbe tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:42.596225 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-31fa7df6-21c9-4c46-aebf-fb177ed0dbbe tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:42.596746 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-31fa7df6-21c9-4c46-aebf-fb177ed0dbbe tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:42.597686 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-31fa7df6-21c9-4c46-aebf-fb177ed0dbbe tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:42.598285 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-31fa7df6-21c9-4c46-aebf-fb177ed0dbbe tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:43.149980 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-31fa7df6-21c9-4c46-aebf-fb177ed0dbbe tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:43.160146 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-31fa7df6-21c9-4c46-aebf-fb177ed0dbbe tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 200 len: 1272 microversion: 2.1 time: 0.600888 Jan 15 02:48:43.160687 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 467/893] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:42 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 1272 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:44.198121 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2966f085-4377-4a78-b56a-41ef4e985c37 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:44.199362 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2966f085-4377-4a78-b56a-41ef4e985c37 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:44.211818 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2966f085-4377-4a78-b56a-41ef4e985c37 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:44.212790 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2966f085-4377-4a78-b56a-41ef4e985c37 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:44.214496 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2966f085-4377-4a78-b56a-41ef4e985c37 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:44.216371 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2966f085-4377-4a78-b56a-41ef4e985c37 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:44.697041 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-2966f085-4377-4a78-b56a-41ef4e985c37 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:44.712397 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2966f085-4377-4a78-b56a-41ef4e985c37 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 200 len: 1460 microversion: 2.1 time: 0.529732 Jan 15 02:48:44.713921 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 427/894] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:44 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 1460 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:48:44.763074 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-62bc0498-a442-45b3-8cb7-1857f77fde8a tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:48:44.764602 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-62bc0498-a442-45b3-8cb7-1857f77fde8a tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:44.786337 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-62bc0498-a442-45b3-8cb7-1857f77fde8a tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:44.795805 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-62bc0498-a442-45b3-8cb7-1857f77fde8a tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:44.797764 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-62bc0498-a442-45b3-8cb7-1857f77fde8a tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:44.798897 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-62bc0498-a442-45b3-8cb7-1857f77fde8a tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:45.102691 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-62bc0498-a442-45b3-8cb7-1857f77fde8a tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:48:45.112398 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-62bc0498-a442-45b3-8cb7-1857f77fde8a tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 200 len: 1460 microversion: 2.1 time: 0.378138 Jan 15 02:48:45.113044 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 468/895] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:48:44 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 1460 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:48:45.136274 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-48a5dca1-1388-4c6c-96a6-94e09501dde4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Action: 'create', calling method: .version_select at 0x7f878e71be18>, body: {"pool": null} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:48:47.447109 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-48a5dca1-1388-4c6c-96a6-94e09501dde4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.319706 Jan 15 02:48:47.447680 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 428/896] 10.222.0.37 () {60 vars in 1160 bytes} [Fri Jan 15 02:48:45 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:48:47.466850 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f7a6805d-28e2-4aa9-be16-8e96bca9fc90 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.1.60"}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:48:47.468082 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f7a6805d-28e2-4aa9-be16-8e96bca9fc90 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:48:47.477339 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f7a6805d-28e2-4aa9-be16-8e96bca9fc90 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:47.478001 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f7a6805d-28e2-4aa9-be16-8e96bca9fc90 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:47.478867 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f7a6805d-28e2-4aa9-be16-8e96bca9fc90 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:47.479359 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f7a6805d-28e2-4aa9-be16-8e96bca9fc90 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:47.584876 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f7a6805d-28e2-4aa9-be16-8e96bca9fc90 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Acquired lock "refresh_cache-883232af-b44d-4667-a346-099139fb27ea" {{(pid=94111) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Jan 15 02:48:49.882412 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-f7a6805d-28e2-4aa9-be16-8e96bca9fc90 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Building network info cache for instance {{(pid=94111) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1831}} Jan 15 02:48:49.897496 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-a507f6fb-5a4e-4d8f-abea-a48b561ea905 req-7994d36c-985a-42a4-b673-f02a0e0629c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "883232af-b44d-4667-a346-099139fb27ea", "tag": "0e3ce2a7-84eb-48d9-9129-f341c2f9f662"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:48:49.915363 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:48:49.915363 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:48:49.931676 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-a507f6fb-5a4e-4d8f-abea-a48b561ea905 req-7994d36c-985a-42a4-b673-f02a0e0629c4 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:48:49.932438 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-a507f6fb-5a4e-4d8f-abea-a48b561ea905 req-7994d36c-985a-42a4-b673-f02a0e0629c4 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:48:49.954402 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-a507f6fb-5a4e-4d8f-abea-a48b561ea905 req-7994d36c-985a-42a4-b673-f02a0e0629c4 service nova] Creating event network-changed:0e3ce2a7-84eb-48d9-9129-f341c2f9f662 for instance 883232af-b44d-4667-a346-099139fb27ea on hv-cinder-76330 Jan 15 02:48:49.960135 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-a507f6fb-5a4e-4d8f-abea-a48b561ea905 req-7994d36c-985a-42a4-b673-f02a0e0629c4 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073224 Jan 15 02:48:49.961315 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 429/897] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:48:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:48:51.753205 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-f7a6805d-28e2-4aa9-be16-8e96bca9fc90 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Updating instance_info_cache with network_info: [{"id": "0e3ce2a7-84eb-48d9-9129-f341c2f9f662", "address": "fa:16:3e:1d:97:d9", "network": {"id": "66972a8b-9a9e-409f-92ab-ee571d05c923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1406902355-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.1.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a605fa30d830427db71d8178d5db456e", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap0e3ce2a7-84", "ovs_interfaceid": "0e3ce2a7-84eb-48d9-9129-f341c2f9f662", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94111) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Jan 15 02:48:51.770417 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f7a6805d-28e2-4aa9-be16-8e96bca9fc90 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Releasing lock "refresh_cache-883232af-b44d-4667-a346-099139fb27ea" {{(pid=94111) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Jan 15 02:48:51.771710 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f7a6805d-28e2-4aa9-be16-8e96bca9fc90 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "POST /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea/action" status: 202 len: 0 microversion: 2.1 time: 4.314628 Jan 15 02:48:51.772618 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 469/898] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:48:47 2021] POST /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea/action => generated 0 bytes in 4316 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jan 15 02:49:09.598884 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 02:49:09.599323 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: Fri Jan 15 02:49:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 02:49:16.186014 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5ccfe8e4-84c0-40bb-9d2a-c8fb86a6cb4e tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Action: 'create', calling method: .version_select at 0x7f878e71b488>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1572793650"}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:49:16.223594 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-5ccfe8e4-84c0-40bb-9d2a-c8fb86a6cb4e tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Getting quotas for project 3c221fae580744f08ab966c3fb47ca29. Resources: {'key_pairs'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:49:16.227755 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-5ccfe8e4-84c0-40bb-9d2a-c8fb86a6cb4e tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Getting quotas for user bccdcc0a6e044a53ad931d652d4c7bbb and project 3c221fae580744f08ab966c3fb47ca29. Resources: {'key_pairs'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:49:16.425295 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-5ccfe8e4-84c0-40bb-9d2a-c8fb86a6cb4e tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Getting quotas for project 3c221fae580744f08ab966c3fb47ca29. Resources: {'key_pairs'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:49:16.429305 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-5ccfe8e4-84c0-40bb-9d2a-c8fb86a6cb4e tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Getting quotas for user bccdcc0a6e044a53ad931d652d4c7bbb and project 3c221fae580744f08ab966c3fb47ca29. Resources: {'key_pairs'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:49:16.442615 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5ccfe8e4-84c0-40bb-9d2a-c8fb86a6cb4e tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.266999 Jan 15 02:49:16.443264 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 430/899] 10.222.0.37 () {60 vars in 1148 bytes} [Fri Jan 15 02:49:16 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:49:16.504802 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d41c6ba4-0e1e-4310-835c-afa8a1b8b033 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-772662549", "imageRef": "d5311db6-c048-4ab6-b8f2-a0284d3cee80", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1572793650", "networks": [{"uuid": "aa41af28-86fc-4815-807c-954e9b8d1655"}]}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:49:16.732437 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-d41c6ba4-0e1e-4310-835c-afa8a1b8b033 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] validate_networks() for [('aa41af28-86fc-4815-807c-954e9b8d1655', None, None, None)] {{(pid=94111) validate_networks /opt/stack/nova/nova/network/neutron.py:2340}} Jan 15 02:49:17.387790 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-d41c6ba4-0e1e-4310-835c-afa8a1b8b033 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Flavor limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 02:49:17.388267 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-d41c6ba4-0e1e-4310-835c-afa8a1b8b033 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Image limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Jan 15 02:49:17.388771 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-d41c6ba4-0e1e-4310-835c-afa8a1b8b033 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Flavor pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 02:49:17.389265 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-d41c6ba4-0e1e-4310-835c-afa8a1b8b033 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Image pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Jan 15 02:49:17.389731 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-d41c6ba4-0e1e-4310-835c-afa8a1b8b033 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Jan 15 02:49:17.398627 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d41c6ba4-0e1e-4310-835c-afa8a1b8b033 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:17.399136 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d41c6ba4-0e1e-4310-835c-afa8a1b8b033 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:17.400261 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d41c6ba4-0e1e-4310-835c-afa8a1b8b033 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:17.400752 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d41c6ba4-0e1e-4310-835c-afa8a1b8b033 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:17.420243 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-d41c6ba4-0e1e-4310-835c-afa8a1b8b033 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Getting quotas for project 3c221fae580744f08ab966c3fb47ca29. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:49:17.424624 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-d41c6ba4-0e1e-4310-835c-afa8a1b8b033 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Getting quotas for user bccdcc0a6e044a53ad931d652d4c7bbb and project 3c221fae580744f08ab966c3fb47ca29. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:49:17.435841 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d41c6ba4-0e1e-4310-835c-afa8a1b8b033 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Going to run 1 instances... {{(pid=94111) _provision_instances /opt/stack/nova/nova/compute/api.py:1263}} Jan 15 02:49:17.438392 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d41c6ba4-0e1e-4310-835c-afa8a1b8b033 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d5311db6-c048-4ab6-b8f2-a0284d3cee80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1661}} Jan 15 02:49:17.492070 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d41c6ba4-0e1e-4310-835c-afa8a1b8b033 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.996535 Jan 15 02:49:17.492708 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 470/900] 10.222.0.37 () {60 vars in 1137 bytes} [Fri Jan 15 02:49:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 02:49:17.509045 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d64cda6e-2eca-425f-b414-a9a8a31b18df tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:49:17.509829 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d64cda6e-2eca-425f-b414-a9a8a31b18df tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:17.693043 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d64cda6e-2eca-425f-b414-a9a8a31b18df tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:49:17.701902 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d64cda6e-2eca-425f-b414-a9a8a31b18df tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1258 microversion: 2.1 time: 0.202343 Jan 15 02:49:17.702493 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 431/901] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:49:17 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1258 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:49:18.725935 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4c58240b-1047-48aa-bd8d-b6fad1932516 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:49:18.726618 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4c58240b-1047-48aa-bd8d-b6fad1932516 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:18.815147 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4c58240b-1047-48aa-bd8d-b6fad1932516 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:49:18.824662 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4c58240b-1047-48aa-bd8d-b6fad1932516 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1258 microversion: 2.1 time: 0.108264 Jan 15 02:49:18.825307 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 471/902] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:49:18 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1258 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:49:19.848372 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1ab59db5-5371-425f-aa99-654605dea7ee tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:49:19.849021 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1ab59db5-5371-425f-aa99-654605dea7ee tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:19.938129 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-1ab59db5-5371-425f-aa99-654605dea7ee tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:49:19.946851 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1ab59db5-5371-425f-aa99-654605dea7ee tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1258 microversion: 2.1 time: 0.107863 Jan 15 02:49:19.947450 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 432/903] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:49:19 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1258 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:49:20.971439 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-14f7f02b-4439-4246-b9ef-38393bdb6f64 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:49:20.972129 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-14f7f02b-4439-4246-b9ef-38393bdb6f64 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:20.980429 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-14f7f02b-4439-4246-b9ef-38393bdb6f64 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:20.980935 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-14f7f02b-4439-4246-b9ef-38393bdb6f64 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:20.981818 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-14f7f02b-4439-4246-b9ef-38393bdb6f64 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:20.982314 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-14f7f02b-4439-4246-b9ef-38393bdb6f64 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:21.118684 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-14f7f02b-4439-4246-b9ef-38393bdb6f64 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:49:21.128197 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-14f7f02b-4439-4246-b9ef-38393bdb6f64 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1262 microversion: 2.1 time: 0.166553 Jan 15 02:49:21.128815 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 472/904] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:49:20 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1262 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:49:22.153624 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-08addf80-0150-4e04-953d-cd5761cff344 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:49:22.154287 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-08addf80-0150-4e04-953d-cd5761cff344 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:22.162337 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-08addf80-0150-4e04-953d-cd5761cff344 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:22.162837 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-08addf80-0150-4e04-953d-cd5761cff344 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:22.163667 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-08addf80-0150-4e04-953d-cd5761cff344 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:22.164156 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-08addf80-0150-4e04-953d-cd5761cff344 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:22.300011 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-08addf80-0150-4e04-953d-cd5761cff344 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:49:22.308940 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-08addf80-0150-4e04-953d-cd5761cff344 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1254 microversion: 2.1 time: 0.165674 Jan 15 02:49:22.309575 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 433/905] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:49:22 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1254 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:49:23.346989 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a81b3626-9cfe-4fa5-98e9-861618f3d602 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:49:23.348989 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a81b3626-9cfe-4fa5-98e9-861618f3d602 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:23.365813 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a81b3626-9cfe-4fa5-98e9-861618f3d602 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:23.367364 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a81b3626-9cfe-4fa5-98e9-861618f3d602 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:23.368956 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a81b3626-9cfe-4fa5-98e9-861618f3d602 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:23.369813 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a81b3626-9cfe-4fa5-98e9-861618f3d602 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:23.826457 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a81b3626-9cfe-4fa5-98e9-861618f3d602 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:49:23.838224 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a81b3626-9cfe-4fa5-98e9-861618f3d602 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1316 microversion: 2.1 time: 0.514443 Jan 15 02:49:23.839349 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 473/906] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:49:23 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1316 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:49:24.874650 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-182dc67a-c2f7-4e37-8cc7-4d23f8f97df4 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:49:24.875347 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-182dc67a-c2f7-4e37-8cc7-4d23f8f97df4 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:24.892728 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-182dc67a-c2f7-4e37-8cc7-4d23f8f97df4 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:24.893275 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-182dc67a-c2f7-4e37-8cc7-4d23f8f97df4 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:24.894124 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-182dc67a-c2f7-4e37-8cc7-4d23f8f97df4 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:24.894617 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-182dc67a-c2f7-4e37-8cc7-4d23f8f97df4 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:25.165572 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-182dc67a-c2f7-4e37-8cc7-4d23f8f97df4 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:49:25.176539 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-182dc67a-c2f7-4e37-8cc7-4d23f8f97df4 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1358 microversion: 2.1 time: 0.322823 Jan 15 02:49:25.177180 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 434/907] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:49:24 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1358 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:49:26.201340 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-78f105e4-b69f-4017-9640-30e1b8b36b10 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:49:26.202029 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-78f105e4-b69f-4017-9640-30e1b8b36b10 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:26.210431 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-78f105e4-b69f-4017-9640-30e1b8b36b10 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:26.211078 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-78f105e4-b69f-4017-9640-30e1b8b36b10 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:26.212028 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-78f105e4-b69f-4017-9640-30e1b8b36b10 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:26.212589 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-78f105e4-b69f-4017-9640-30e1b8b36b10 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:26.511748 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-78f105e4-b69f-4017-9640-30e1b8b36b10 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:49:26.520719 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-78f105e4-b69f-4017-9640-30e1b8b36b10 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1358 microversion: 2.1 time: 0.329013 Jan 15 02:49:26.521337 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 474/908] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:49:26 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1358 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:49:27.546123 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9301fb87-9026-4fb7-969f-13387af038fa tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:49:27.546791 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9301fb87-9026-4fb7-969f-13387af038fa tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:27.555214 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9301fb87-9026-4fb7-969f-13387af038fa tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:27.555728 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9301fb87-9026-4fb7-969f-13387af038fa tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:27.556586 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9301fb87-9026-4fb7-969f-13387af038fa tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:27.557107 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9301fb87-9026-4fb7-969f-13387af038fa tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:27.830760 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-9301fb87-9026-4fb7-969f-13387af038fa tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:49:27.840621 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9301fb87-9026-4fb7-969f-13387af038fa tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1358 microversion: 2.1 time: 0.305004 Jan 15 02:49:27.841447 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 435/909] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:49:27 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1358 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:49:28.866817 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9b0aeb8f-3085-4b5d-bb4c-fba9c74aa76c tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:49:28.867783 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9b0aeb8f-3085-4b5d-bb4c-fba9c74aa76c tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:28.876483 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9b0aeb8f-3085-4b5d-bb4c-fba9c74aa76c tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:28.876992 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9b0aeb8f-3085-4b5d-bb4c-fba9c74aa76c tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:28.877890 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9b0aeb8f-3085-4b5d-bb4c-fba9c74aa76c tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:28.878386 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9b0aeb8f-3085-4b5d-bb4c-fba9c74aa76c tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:29.126068 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-9b0aeb8f-3085-4b5d-bb4c-fba9c74aa76c tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:49:29.136209 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9b0aeb8f-3085-4b5d-bb4c-fba9c74aa76c tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1358 microversion: 2.1 time: 0.279688 Jan 15 02:49:29.137304 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 475/910] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:49:28 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1358 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:49:30.160844 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4a5fe960-039d-4757-bad5-77844c277386 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:49:30.161442 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4a5fe960-039d-4757-bad5-77844c277386 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:30.170533 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4a5fe960-039d-4757-bad5-77844c277386 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:30.171045 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4a5fe960-039d-4757-bad5-77844c277386 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:30.171896 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4a5fe960-039d-4757-bad5-77844c277386 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:30.172393 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4a5fe960-039d-4757-bad5-77844c277386 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:30.431390 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4a5fe960-039d-4757-bad5-77844c277386 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:49:30.441369 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4a5fe960-039d-4757-bad5-77844c277386 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1358 microversion: 2.1 time: 0.291547 Jan 15 02:49:30.442171 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 436/911] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:49:30 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1358 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:49:31.470038 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3a6877be-22f9-4a93-8c8b-aef79a6961a0 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:49:31.470730 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3a6877be-22f9-4a93-8c8b-aef79a6961a0 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:31.480588 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a6877be-22f9-4a93-8c8b-aef79a6961a0 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:31.481161 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a6877be-22f9-4a93-8c8b-aef79a6961a0 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:31.482038 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a6877be-22f9-4a93-8c8b-aef79a6961a0 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:31.482532 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3a6877be-22f9-4a93-8c8b-aef79a6961a0 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:31.758840 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3a6877be-22f9-4a93-8c8b-aef79a6961a0 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:49:31.768699 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3a6877be-22f9-4a93-8c8b-aef79a6961a0 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1358 microversion: 2.1 time: 0.309628 Jan 15 02:49:31.769356 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 476/912] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:49:31 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1358 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:49:32.794785 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2bc6e30c-f018-4a4c-8e1b-db2bdf711df2 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:49:32.796111 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2bc6e30c-f018-4a4c-8e1b-db2bdf711df2 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:32.804310 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2bc6e30c-f018-4a4c-8e1b-db2bdf711df2 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:32.804833 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2bc6e30c-f018-4a4c-8e1b-db2bdf711df2 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:32.805720 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2bc6e30c-f018-4a4c-8e1b-db2bdf711df2 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:32.806218 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2bc6e30c-f018-4a4c-8e1b-db2bdf711df2 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:33.058068 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-2bc6e30c-f018-4a4c-8e1b-db2bdf711df2 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:49:33.067168 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2bc6e30c-f018-4a4c-8e1b-db2bdf711df2 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1358 microversion: 2.1 time: 0.282810 Jan 15 02:49:33.067754 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 437/913] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:49:32 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1358 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:49:34.091137 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c8651aa4-7e85-4435-991d-26ed68e05562 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:49:34.091730 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c8651aa4-7e85-4435-991d-26ed68e05562 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:34.099587 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c8651aa4-7e85-4435-991d-26ed68e05562 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:34.100096 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c8651aa4-7e85-4435-991d-26ed68e05562 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:34.100984 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c8651aa4-7e85-4435-991d-26ed68e05562 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:34.101505 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c8651aa4-7e85-4435-991d-26ed68e05562 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:34.611770 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-c8651aa4-7e85-4435-991d-26ed68e05562 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:49:34.621473 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c8651aa4-7e85-4435-991d-26ed68e05562 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1358 microversion: 2.1 time: 0.540172 Jan 15 02:49:34.622231 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 477/914] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:49:34 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1358 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:49:35.030590 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-a487b6ea-d0a5-4bef-8e76-b56e0c7a5874 req-58ee1dfb-85ee-4a99-b1c8-297545f3db74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2b63947-dd66-4609-984f-d991ce567e3d", "tag": "052f801e-5017-44ed-970e-8d35ccd4f7f0"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:49:35.041616 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:49:35.041616 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:49:35.051206 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-a487b6ea-d0a5-4bef-8e76-b56e0c7a5874 req-58ee1dfb-85ee-4a99-b1c8-297545f3db74 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:35.051682 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-a487b6ea-d0a5-4bef-8e76-b56e0c7a5874 req-58ee1dfb-85ee-4a99-b1c8-297545f3db74 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:35.071030 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-a487b6ea-d0a5-4bef-8e76-b56e0c7a5874 req-58ee1dfb-85ee-4a99-b1c8-297545f3db74 service nova] Creating event network-changed:052f801e-5017-44ed-970e-8d35ccd4f7f0 for instance f2b63947-dd66-4609-984f-d991ce567e3d on hv-cinder-76330 Jan 15 02:49:35.076895 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-a487b6ea-d0a5-4bef-8e76-b56e0c7a5874 req-58ee1dfb-85ee-4a99-b1c8-297545f3db74 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058742 Jan 15 02:49:35.077578 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 438/915] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:49:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:49:35.648207 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a230e519-0685-4f24-99fa-5d8ddbff1606 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:49:35.648889 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a230e519-0685-4f24-99fa-5d8ddbff1606 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:35.658948 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a230e519-0685-4f24-99fa-5d8ddbff1606 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:35.659457 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a230e519-0685-4f24-99fa-5d8ddbff1606 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:35.660331 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a230e519-0685-4f24-99fa-5d8ddbff1606 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:35.660831 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a230e519-0685-4f24-99fa-5d8ddbff1606 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:36.100952 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a230e519-0685-4f24-99fa-5d8ddbff1606 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:49:36.110817 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a230e519-0685-4f24-99fa-5d8ddbff1606 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1358 microversion: 2.1 time: 0.474067 Jan 15 02:49:36.111420 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 478/916] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:49:35 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1358 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:49:37.136295 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4ac049bc-e261-4935-85ea-4593a6d7c905 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:49:37.136849 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4ac049bc-e261-4935-85ea-4593a6d7c905 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:37.144786 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4ac049bc-e261-4935-85ea-4593a6d7c905 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:37.145344 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4ac049bc-e261-4935-85ea-4593a6d7c905 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:37.146176 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4ac049bc-e261-4935-85ea-4593a6d7c905 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:37.146811 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4ac049bc-e261-4935-85ea-4593a6d7c905 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:37.390836 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4ac049bc-e261-4935-85ea-4593a6d7c905 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:49:37.399963 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4ac049bc-e261-4935-85ea-4593a6d7c905 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1358 microversion: 2.1 time: 0.274228 Jan 15 02:49:37.400560 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 439/917] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:49:37 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1358 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:49:38.423477 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-0113c70a-1bc4-434e-9a9a-ae519e62a976 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:49:38.424151 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-0113c70a-1bc4-434e-9a9a-ae519e62a976 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:38.432176 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0113c70a-1bc4-434e-9a9a-ae519e62a976 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:38.432777 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0113c70a-1bc4-434e-9a9a-ae519e62a976 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:38.433659 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0113c70a-1bc4-434e-9a9a-ae519e62a976 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:38.434157 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0113c70a-1bc4-434e-9a9a-ae519e62a976 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:38.690023 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0113c70a-1bc4-434e-9a9a-ae519e62a976 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:49:38.699623 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-0113c70a-1bc4-434e-9a9a-ae519e62a976 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1358 microversion: 2.1 time: 0.285389 Jan 15 02:49:38.700422 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 479/918] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:49:38 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1358 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:49:38.769407 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-6b4504d9-5511-4e2e-aa85-055ec34a9ab5 req-6165596d-9e8d-4bec-b593-7548394f90d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b63947-dd66-4609-984f-d991ce567e3d", "name": "network-vif-plugged", "status": "completed", "tag": "052f801e-5017-44ed-970e-8d35ccd4f7f0"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:49:38.776685 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:49:38.776685 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:49:38.785734 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-6b4504d9-5511-4e2e-aa85-055ec34a9ab5 req-6165596d-9e8d-4bec-b593-7548394f90d3 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:38.786238 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-6b4504d9-5511-4e2e-aa85-055ec34a9ab5 req-6165596d-9e8d-4bec-b593-7548394f90d3 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:38.804560 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-6b4504d9-5511-4e2e-aa85-055ec34a9ab5 req-6165596d-9e8d-4bec-b593-7548394f90d3 service nova] Creating event network-vif-plugged:052f801e-5017-44ed-970e-8d35ccd4f7f0 for instance f2b63947-dd66-4609-984f-d991ce567e3d on hv-cinder-76330 Jan 15 02:49:38.810475 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-6b4504d9-5511-4e2e-aa85-055ec34a9ab5 req-6165596d-9e8d-4bec-b593-7548394f90d3 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052425 Jan 15 02:49:38.811344 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 440/919] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:49:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:49:39.723411 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-8966857d-e25a-417f-8810-f8e2401864bb tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:49:39.724063 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8966857d-e25a-417f-8810-f8e2401864bb tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:39.732945 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8966857d-e25a-417f-8810-f8e2401864bb tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:39.733509 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8966857d-e25a-417f-8810-f8e2401864bb tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:39.734357 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8966857d-e25a-417f-8810-f8e2401864bb tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:39.734855 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8966857d-e25a-417f-8810-f8e2401864bb tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:39.976756 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-8966857d-e25a-417f-8810-f8e2401864bb tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:49:39.986666 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-8966857d-e25a-417f-8810-f8e2401864bb tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1358 microversion: 2.1 time: 0.272753 Jan 15 02:49:39.987259 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 480/920] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:49:39 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1358 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:49:41.012367 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ccf1ac7f-29a0-4d0d-817d-c946499de26d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:49:41.013123 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ccf1ac7f-29a0-4d0d-817d-c946499de26d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:41.021851 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ccf1ac7f-29a0-4d0d-817d-c946499de26d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:41.022365 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ccf1ac7f-29a0-4d0d-817d-c946499de26d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:41.023218 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ccf1ac7f-29a0-4d0d-817d-c946499de26d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:41.023719 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ccf1ac7f-29a0-4d0d-817d-c946499de26d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:41.268011 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-ccf1ac7f-29a0-4d0d-817d-c946499de26d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:49:41.277763 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ccf1ac7f-29a0-4d0d-817d-c946499de26d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1547 microversion: 2.1 time: 0.275630 Jan 15 02:49:41.278398 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 441/921] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:49:41 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1547 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:49:41.300650 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-96d2a4b2-7d3b-48bb-bfb6-4cbc5bb740f7 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:49:41.301356 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-96d2a4b2-7d3b-48bb-bfb6-4cbc5bb740f7 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:41.310348 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-96d2a4b2-7d3b-48bb-bfb6-4cbc5bb740f7 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:41.310861 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-96d2a4b2-7d3b-48bb-bfb6-4cbc5bb740f7 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:41.311756 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-96d2a4b2-7d3b-48bb-bfb6-4cbc5bb740f7 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:41.312251 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-96d2a4b2-7d3b-48bb-bfb6-4cbc5bb740f7 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:41.558387 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-96d2a4b2-7d3b-48bb-bfb6-4cbc5bb740f7 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:49:41.567276 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-96d2a4b2-7d3b-48bb-bfb6-4cbc5bb740f7 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1547 microversion: 2.1 time: 0.276329 Jan 15 02:49:41.567876 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 481/922] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:49:41 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1547 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:49:41.591229 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-0f2d3e1f-0748-4440-a8dc-018d4a7f0404 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:49:41.605241 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:49:41.605241 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:49:41.606336 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0f2d3e1f-0748-4440-a8dc-018d4a7f0404 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:49:41.607173 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-0f2d3e1f-0748-4440-a8dc-018d4a7f0404 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Searching by: {'deleted': False, 'project_id': '3c221fae580744f08ab966c3fb47ca29'} {{(pid=94112) get_all /opt/stack/nova/nova/compute/api.py:2828}} Jan 15 02:49:41.613039 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0f2d3e1f-0748-4440-a8dc-018d4a7f0404 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:41.613580 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0f2d3e1f-0748-4440-a8dc-018d4a7f0404 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:41.614450 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0f2d3e1f-0748-4440-a8dc-018d4a7f0404 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:41.614944 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0f2d3e1f-0748-4440-a8dc-018d4a7f0404 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:41.719355 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.multi_cell_list [None req-0f2d3e1f-0748-4440-a8dc-018d4a7f0404 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=94112) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:376}} Jan 15 02:49:41.817551 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-0f2d3e1f-0748-4440-a8dc-018d4a7f0404 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.236057 Jan 15 02:49:41.818097 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 442/923] 10.222.0.37 () {58 vars in 1115 bytes} [Fri Jan 15 02:49:41 2021] GET /compute/v2.1/servers => generated 342 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:49:41.834968 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-16f00d7b-1ebc-4d1a-b57e-ff85871e6317 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:49:41.835677 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-16f00d7b-1ebc-4d1a-b57e-ff85871e6317 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:41.843586 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-16f00d7b-1ebc-4d1a-b57e-ff85871e6317 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:41.844088 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-16f00d7b-1ebc-4d1a-b57e-ff85871e6317 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:41.844952 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-16f00d7b-1ebc-4d1a-b57e-ff85871e6317 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:41.845500 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-16f00d7b-1ebc-4d1a-b57e-ff85871e6317 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:42.086124 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-16f00d7b-1ebc-4d1a-b57e-ff85871e6317 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:49:42.094912 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-16f00d7b-1ebc-4d1a-b57e-ff85871e6317 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1547 microversion: 2.1 time: 0.268961 Jan 15 02:49:42.095498 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 482/924] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:49:41 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1547 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:49:43.948911 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2b9b8919-caef-43d0-9a37-671aa1a9f6a1 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a4d25c7-a881-46a7-950c-d51461f5cf34"}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:49:43.950189 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-2b9b8919-caef-43d0-9a37-671aa1a9f6a1 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:43.958138 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2b9b8919-caef-43d0-9a37-671aa1a9f6a1 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:43.958652 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2b9b8919-caef-43d0-9a37-671aa1a9f6a1 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:43.959495 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2b9b8919-caef-43d0-9a37-671aa1a9f6a1 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:43.959992 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-2b9b8919-caef-43d0-9a37-671aa1a9f6a1 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:44.346273 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2b9b8919-caef-43d0-9a37-671aa1a9f6a1 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "POST /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.406800 Jan 15 02:49:44.347128 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 443/925] 10.222.0.37 () {60 vars in 1313 bytes} [Fri Jan 15 02:49:43 2021] POST /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d/os-volume_attachments => generated 194 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:49:52.397535 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-9f9262e1-b159-4a59-9da8-6e18b496bd5a tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:49:52.398211 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-9f9262e1-b159-4a59-9da8-6e18b496bd5a tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:52.407725 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9f9262e1-b159-4a59-9da8-6e18b496bd5a tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:52.408239 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9f9262e1-b159-4a59-9da8-6e18b496bd5a tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:52.409165 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9f9262e1-b159-4a59-9da8-6e18b496bd5a tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:52.409663 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-9f9262e1-b159-4a59-9da8-6e18b496bd5a tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:52.653048 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-9f9262e1-b159-4a59-9da8-6e18b496bd5a tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:49:52.663211 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-9f9262e1-b159-4a59-9da8-6e18b496bd5a tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1593 microversion: 2.1 time: 0.275290 Jan 15 02:49:52.663809 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 483/926] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:49:52 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1593 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:49:52.686820 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5753353f-ab25-4bf7-83a8-f6c1791c7c37 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Action: 'create', calling method: .version_select at 0x7f878e71b840>, body: {"pool": null} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:49:54.743970 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5753353f-ab25-4bf7-83a8-f6c1791c7c37 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.067152 Jan 15 02:49:54.744642 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 444/927] 10.222.0.37 () {60 vars in 1160 bytes} [Fri Jan 15 02:49:52 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:49:54.762540 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f87d33a4-0a6d-4c21-a377-2435b82f8044 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.1.165"}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:49:54.763839 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f87d33a4-0a6d-4c21-a377-2435b82f8044 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:54.772353 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f87d33a4-0a6d-4c21-a377-2435b82f8044 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:54.772859 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f87d33a4-0a6d-4c21-a377-2435b82f8044 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:54.773731 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f87d33a4-0a6d-4c21-a377-2435b82f8044 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:54.774222 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f87d33a4-0a6d-4c21-a377-2435b82f8044 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:54.843752 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f87d33a4-0a6d-4c21-a377-2435b82f8044 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Acquired lock "refresh_cache-f2b63947-dd66-4609-984f-d991ce567e3d" {{(pid=94111) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Jan 15 02:49:56.533327 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-f87d33a4-0a6d-4c21-a377-2435b82f8044 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Building network info cache for instance {{(pid=94111) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1831}} Jan 15 02:49:56.547987 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-63de7ce3-48d1-493a-ba1f-cf996c7dcfe4 req-91a876e6-6e7f-4a82-9830-6d150a1394a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2b63947-dd66-4609-984f-d991ce567e3d", "tag": "052f801e-5017-44ed-970e-8d35ccd4f7f0"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:49:56.555198 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:49:56.555198 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:49:56.565475 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-63de7ce3-48d1-493a-ba1f-cf996c7dcfe4 req-91a876e6-6e7f-4a82-9830-6d150a1394a3 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:56.565983 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-63de7ce3-48d1-493a-ba1f-cf996c7dcfe4 req-91a876e6-6e7f-4a82-9830-6d150a1394a3 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:56.584925 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-63de7ce3-48d1-493a-ba1f-cf996c7dcfe4 req-91a876e6-6e7f-4a82-9830-6d150a1394a3 service nova] Creating event network-changed:052f801e-5017-44ed-970e-8d35ccd4f7f0 for instance f2b63947-dd66-4609-984f-d991ce567e3d on hv-cinder-76330 Jan 15 02:49:56.590288 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-63de7ce3-48d1-493a-ba1f-cf996c7dcfe4 req-91a876e6-6e7f-4a82-9830-6d150a1394a3 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051932 Jan 15 02:49:56.591122 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 445/928] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:49:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:49:58.331823 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-f87d33a4-0a6d-4c21-a377-2435b82f8044 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Updating instance_info_cache with network_info: [{"id": "052f801e-5017-44ed-970e-8d35ccd4f7f0", "address": "fa:16:3e:63:14:e5", "network": {"id": "aa41af28-86fc-4815-807c-954e9b8d1655", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-926942052-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.1.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3c221fae580744f08ab966c3fb47ca29", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap052f801e-50", "ovs_interfaceid": "052f801e-5017-44ed-970e-8d35ccd4f7f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94111) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Jan 15 02:49:58.343325 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f87d33a4-0a6d-4c21-a377-2435b82f8044 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Releasing lock "refresh_cache-f2b63947-dd66-4609-984f-d991ce567e3d" {{(pid=94111) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Jan 15 02:49:58.344367 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f87d33a4-0a6d-4c21-a377-2435b82f8044 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "POST /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d/action" status: 202 len: 0 microversion: 2.1 time: 3.591240 Jan 15 02:49:58.345232 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 484/929] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:49:54 2021] POST /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d/action => generated 0 bytes in 3593 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jan 15 02:49:58.360749 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-776f78c6-4164-4d12-af86-fce2be108468 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Action: 'create', calling method: .version_select at 0x7f878e78b488>, body: {"security_group": {"name": "tempest-TestMinimumBasicScenario-2049868195", "description": "tempest-TestMinimumBasicScenario-2049868195 description"}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:49:58.583013 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-776f78c6-4164-4d12-af86-fce2be108468 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "POST /compute/v2.1/os-security-groups" status: 200 len: 257 microversion: 2.1 time: 0.232795 Jan 15 02:49:58.583658 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 446/930] 10.222.0.37 () {60 vars in 1170 bytes} [Fri Jan 15 02:49:58 2021] POST /compute/v2.1/os-security-groups => generated 257 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:49:58.601786 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c0a947f6-aa40-4983-92fb-386442a17de8 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Action: 'create', calling method: .version_select at 0x7f878f1f1620>, body: {"security_group_rule": {"parent_group_id": "9e0ce083-6b2d-4062-b534-9d1d9fb2579e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:49:58.824618 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c0a947f6-aa40-4983-92fb-386442a17de8 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.232466 Jan 15 02:49:58.825304 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 485/931] 10.222.0.37 () {60 vars in 1185 bytes} [Fri Jan 15 02:49:58 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:49:58.842578 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-65b5dd23-5f4b-4767-95f7-19f80a0d7bb7 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Action: 'create', calling method: .version_select at 0x7f878e78b950>, body: {"security_group_rule": {"parent_group_id": "9e0ce083-6b2d-4062-b534-9d1d9fb2579e", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:49:59.071288 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-65b5dd23-5f4b-4767-95f7-19f80a0d7bb7 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.238309 Jan 15 02:49:59.071948 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 447/932] 10.222.0.37 () {60 vars in 1185 bytes} [Fri Jan 15 02:49:58 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:49:59.088880 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1685eef9-ca20-4a5d-99cb-904e376fce7c tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-TestMinimumBasicScenario-2049868195"}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:49:59.089500 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1685eef9-ca20-4a5d-99cb-904e376fce7c tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:49:59.097685 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1685eef9-ca20-4a5d-99cb-904e376fce7c tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:59.098196 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1685eef9-ca20-4a5d-99cb-904e376fce7c tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:59.099023 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1685eef9-ca20-4a5d-99cb-904e376fce7c tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:49:59.099518 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1685eef9-ca20-4a5d-99cb-904e376fce7c tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:49:59.330376 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.network.security_group_api [None req-1685eef9-ca20-4a5d-99cb-904e376fce7c tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Adding security group 9e0ce083-6b2d-4062-b534-9d1d9fb2579e to port 052f801e-5017-44ed-970e-8d35ccd4f7f0 Jan 15 02:50:00.071768 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1685eef9-ca20-4a5d-99cb-904e376fce7c tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "POST /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d/action" status: 202 len: 0 microversion: 2.1 time: 0.992064 Jan 15 02:50:00.073106 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 486/933] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:49:59 2021] POST /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d/action => generated 0 bytes in 994 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:50:00.086420 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-20d12199-0007-4da2-8aff-59c741c1b2a8 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:00.086698 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-a1cb2a46-4e08-49d8-8678-bdf5880c1fdd req-0f7f12db-35ed-42a3-8ad2-79fd84b2b26e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2b63947-dd66-4609-984f-d991ce567e3d", "tag": "052f801e-5017-44ed-970e-8d35ccd4f7f0"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:50:00.087109 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-20d12199-0007-4da2-8aff-59c741c1b2a8 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:00.094197 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:50:00.094197 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:50:00.095795 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-20d12199-0007-4da2-8aff-59c741c1b2a8 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:00.096338 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-20d12199-0007-4da2-8aff-59c741c1b2a8 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:00.097236 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-20d12199-0007-4da2-8aff-59c741c1b2a8 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:00.097741 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-20d12199-0007-4da2-8aff-59c741c1b2a8 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:00.104348 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-a1cb2a46-4e08-49d8-8678-bdf5880c1fdd req-0f7f12db-35ed-42a3-8ad2-79fd84b2b26e service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:00.104946 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-a1cb2a46-4e08-49d8-8678-bdf5880c1fdd req-0f7f12db-35ed-42a3-8ad2-79fd84b2b26e service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:00.124435 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-a1cb2a46-4e08-49d8-8678-bdf5880c1fdd req-0f7f12db-35ed-42a3-8ad2-79fd84b2b26e service nova] Creating event network-changed:052f801e-5017-44ed-970e-8d35ccd4f7f0 for instance f2b63947-dd66-4609-984f-d991ce567e3d on hv-cinder-76330 Jan 15 02:50:00.130183 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-a1cb2a46-4e08-49d8-8678-bdf5880c1fdd req-0f7f12db-35ed-42a3-8ad2-79fd84b2b26e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052625 Jan 15 02:50:00.130802 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 448/934] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:50:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:50:00.535267 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-20d12199-0007-4da2-8aff-59c741c1b2a8 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:00.545516 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-20d12199-0007-4da2-8aff-59c741c1b2a8 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1769 microversion: 2.1 time: 0.468178 Jan 15 02:50:00.546216 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 487/935] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:00 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1769 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:14.290913 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f4482326-b900-4c3b-862f-715163bedeac tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:50:14.292149 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f4482326-b900-4c3b-862f-715163bedeac tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:14.300727 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f4482326-b900-4c3b-862f-715163bedeac tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:14.301276 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f4482326-b900-4c3b-862f-715163bedeac tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:14.302123 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f4482326-b900-4c3b-862f-715163bedeac tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:14.302629 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f4482326-b900-4c3b-862f-715163bedeac tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:14.457431 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f4482326-b900-4c3b-862f-715163bedeac tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "POST /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d/action" status: 202 len: 0 microversion: 2.1 time: 0.177227 Jan 15 02:50:14.458144 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 449/936] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:50:14 2021] POST /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:50:14.471996 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a233d3ed-e836-4c37-8464-0f83742f2f57 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:14.472666 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a233d3ed-e836-4c37-8464-0f83742f2f57 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:14.481379 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a233d3ed-e836-4c37-8464-0f83742f2f57 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:14.481894 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a233d3ed-e836-4c37-8464-0f83742f2f57 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:14.482742 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a233d3ed-e836-4c37-8464-0f83742f2f57 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:14.483396 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a233d3ed-e836-4c37-8464-0f83742f2f57 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:14.884518 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a233d3ed-e836-4c37-8464-0f83742f2f57 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:14.894357 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a233d3ed-e836-4c37-8464-0f83742f2f57 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1761 microversion: 2.1 time: 0.431635 Jan 15 02:50:14.894957 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 488/937] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:14 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1761 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:15.919636 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b573556a-01ee-48ce-b2aa-f65e1b5714fa tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:15.921178 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b573556a-01ee-48ce-b2aa-f65e1b5714fa tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:15.929428 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b573556a-01ee-48ce-b2aa-f65e1b5714fa tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:15.929884 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b573556a-01ee-48ce-b2aa-f65e1b5714fa tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:15.930711 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b573556a-01ee-48ce-b2aa-f65e1b5714fa tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:15.931201 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b573556a-01ee-48ce-b2aa-f65e1b5714fa tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:16.199010 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b573556a-01ee-48ce-b2aa-f65e1b5714fa tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:16.208374 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b573556a-01ee-48ce-b2aa-f65e1b5714fa tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1766 microversion: 2.1 time: 0.298409 Jan 15 02:50:16.208965 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 450/938] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:15 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1766 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:17.232264 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b69c3662-b7ca-4a6b-b26c-24c6c9fae106 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:17.233487 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b69c3662-b7ca-4a6b-b26c-24c6c9fae106 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:17.241601 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b69c3662-b7ca-4a6b-b26c-24c6c9fae106 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:17.242101 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b69c3662-b7ca-4a6b-b26c-24c6c9fae106 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:17.242938 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b69c3662-b7ca-4a6b-b26c-24c6c9fae106 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:17.243425 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b69c3662-b7ca-4a6b-b26c-24c6c9fae106 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:17.497070 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b69c3662-b7ca-4a6b-b26c-24c6c9fae106 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:17.506899 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b69c3662-b7ca-4a6b-b26c-24c6c9fae106 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1766 microversion: 2.1 time: 0.283741 Jan 15 02:50:17.507501 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 489/939] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:17 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1766 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:18.531716 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-16127e01-97c4-4b8f-8eff-922de2752fe8 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:18.532393 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-16127e01-97c4-4b8f-8eff-922de2752fe8 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:18.540362 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-16127e01-97c4-4b8f-8eff-922de2752fe8 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:18.540880 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-16127e01-97c4-4b8f-8eff-922de2752fe8 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:18.541751 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-16127e01-97c4-4b8f-8eff-922de2752fe8 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:18.542255 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-16127e01-97c4-4b8f-8eff-922de2752fe8 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:18.789880 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-16127e01-97c4-4b8f-8eff-922de2752fe8 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:18.799919 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-16127e01-97c4-4b8f-8eff-922de2752fe8 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1766 microversion: 2.1 time: 0.277834 Jan 15 02:50:18.800511 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 451/940] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:18 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1766 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:19.823465 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-cff6e214-db2f-4909-8391-23a2c692a12d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:19.824136 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-cff6e214-db2f-4909-8391-23a2c692a12d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:19.833430 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cff6e214-db2f-4909-8391-23a2c692a12d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:19.833941 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cff6e214-db2f-4909-8391-23a2c692a12d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:19.834781 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cff6e214-db2f-4909-8391-23a2c692a12d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:19.835277 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-cff6e214-db2f-4909-8391-23a2c692a12d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:20.079972 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-cff6e214-db2f-4909-8391-23a2c692a12d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:20.089332 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-cff6e214-db2f-4909-8391-23a2c692a12d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1766 microversion: 2.1 time: 0.275015 Jan 15 02:50:20.089918 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 490/941] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:19 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1766 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:21.113518 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5c2be8d7-7344-461e-a600-f548c536a2ca tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:21.114169 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5c2be8d7-7344-461e-a600-f548c536a2ca tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:21.122025 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5c2be8d7-7344-461e-a600-f548c536a2ca tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:21.122529 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5c2be8d7-7344-461e-a600-f548c536a2ca tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:21.123470 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5c2be8d7-7344-461e-a600-f548c536a2ca tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:21.123962 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5c2be8d7-7344-461e-a600-f548c536a2ca tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:21.371043 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-5c2be8d7-7344-461e-a600-f548c536a2ca tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:21.381786 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5c2be8d7-7344-461e-a600-f548c536a2ca tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1766 microversion: 2.1 time: 0.277582 Jan 15 02:50:21.382382 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 452/942] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:21 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1766 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:22.407017 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-621721f3-5bdd-40a2-9c64-1a0f3437d328 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:22.407670 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-621721f3-5bdd-40a2-9c64-1a0f3437d328 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:22.415547 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-621721f3-5bdd-40a2-9c64-1a0f3437d328 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:22.416051 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-621721f3-5bdd-40a2-9c64-1a0f3437d328 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:22.416891 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-621721f3-5bdd-40a2-9c64-1a0f3437d328 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:22.417405 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-621721f3-5bdd-40a2-9c64-1a0f3437d328 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:22.666548 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-621721f3-5bdd-40a2-9c64-1a0f3437d328 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:22.675990 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-621721f3-5bdd-40a2-9c64-1a0f3437d328 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1766 microversion: 2.1 time: 0.279209 Jan 15 02:50:22.676704 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 491/943] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:22 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1766 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:23.699877 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ad9cd1b6-1848-4b99-b8df-ffe9af79c71e tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:23.700546 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ad9cd1b6-1848-4b99-b8df-ffe9af79c71e tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:23.709203 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ad9cd1b6-1848-4b99-b8df-ffe9af79c71e tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:23.709716 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ad9cd1b6-1848-4b99-b8df-ffe9af79c71e tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:23.710549 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ad9cd1b6-1848-4b99-b8df-ffe9af79c71e tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:23.711044 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ad9cd1b6-1848-4b99-b8df-ffe9af79c71e tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:23.959675 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-ad9cd1b6-1848-4b99-b8df-ffe9af79c71e tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:23.969434 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ad9cd1b6-1848-4b99-b8df-ffe9af79c71e tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1766 microversion: 2.1 time: 0.279208 Jan 15 02:50:23.970029 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 453/944] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:23 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1766 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:24.993645 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-0775c265-07f3-41e7-b298-1796f9af3100 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:24.994203 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-0775c265-07f3-41e7-b298-1796f9af3100 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:25.002919 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0775c265-07f3-41e7-b298-1796f9af3100 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:25.003428 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0775c265-07f3-41e7-b298-1796f9af3100 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:25.004272 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0775c265-07f3-41e7-b298-1796f9af3100 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:25.004764 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0775c265-07f3-41e7-b298-1796f9af3100 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:25.268271 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0775c265-07f3-41e7-b298-1796f9af3100 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:25.278102 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-0775c265-07f3-41e7-b298-1796f9af3100 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1766 microversion: 2.1 time: 0.294146 Jan 15 02:50:25.278698 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 492/945] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:24 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1766 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:26.303928 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-781c15a8-d978-40d9-904e-42a53246131d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:26.304621 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-781c15a8-d978-40d9-904e-42a53246131d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:26.314104 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-781c15a8-d978-40d9-904e-42a53246131d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:26.314619 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-781c15a8-d978-40d9-904e-42a53246131d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:26.315471 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-781c15a8-d978-40d9-904e-42a53246131d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:26.315966 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-781c15a8-d978-40d9-904e-42a53246131d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:26.571015 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-781c15a8-d978-40d9-904e-42a53246131d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:26.581434 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-781c15a8-d978-40d9-904e-42a53246131d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1766 microversion: 2.1 time: 0.288067 Jan 15 02:50:26.582041 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 454/946] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:26 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1766 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:27.605377 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-0571f9b6-f0d2-4010-b0cd-04e263e23c70 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:27.605980 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-0571f9b6-f0d2-4010-b0cd-04e263e23c70 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:27.614819 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0571f9b6-f0d2-4010-b0cd-04e263e23c70 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:27.615326 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0571f9b6-f0d2-4010-b0cd-04e263e23c70 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:27.616168 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0571f9b6-f0d2-4010-b0cd-04e263e23c70 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:27.616659 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0571f9b6-f0d2-4010-b0cd-04e263e23c70 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:27.999527 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-0571f9b6-f0d2-4010-b0cd-04e263e23c70 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:28.008957 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-0571f9b6-f0d2-4010-b0cd-04e263e23c70 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1766 microversion: 2.1 time: 0.412869 Jan 15 02:50:28.009591 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 493/947] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:27 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1766 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:29.033221 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-87fc919a-b9c0-49b6-b9a9-ac8095f0aa6d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:29.033786 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-87fc919a-b9c0-49b6-b9a9-ac8095f0aa6d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:29.041678 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-87fc919a-b9c0-49b6-b9a9-ac8095f0aa6d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:29.042184 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-87fc919a-b9c0-49b6-b9a9-ac8095f0aa6d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:29.043023 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-87fc919a-b9c0-49b6-b9a9-ac8095f0aa6d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:29.043522 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-87fc919a-b9c0-49b6-b9a9-ac8095f0aa6d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:29.288232 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-87fc919a-b9c0-49b6-b9a9-ac8095f0aa6d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:29.298361 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-87fc919a-b9c0-49b6-b9a9-ac8095f0aa6d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1766 microversion: 2.1 time: 0.274847 Jan 15 02:50:29.298946 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 455/948] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:29 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1766 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:30.322070 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d9ca15d0-748c-413e-aee4-6ca40879cfd9 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:30.322757 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d9ca15d0-748c-413e-aee4-6ca40879cfd9 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:30.332626 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d9ca15d0-748c-413e-aee4-6ca40879cfd9 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:30.333364 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d9ca15d0-748c-413e-aee4-6ca40879cfd9 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:30.334226 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d9ca15d0-748c-413e-aee4-6ca40879cfd9 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:30.334724 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d9ca15d0-748c-413e-aee4-6ca40879cfd9 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:30.583812 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d9ca15d0-748c-413e-aee4-6ca40879cfd9 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:30.593586 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d9ca15d0-748c-413e-aee4-6ca40879cfd9 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1766 microversion: 2.1 time: 0.280720 Jan 15 02:50:30.594170 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 494/949] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:30 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1766 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:31.618772 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3bcfc692-fd84-456e-8ec4-fbb8c8e08b6d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:31.619423 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3bcfc692-fd84-456e-8ec4-fbb8c8e08b6d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:31.628062 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3bcfc692-fd84-456e-8ec4-fbb8c8e08b6d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:31.628569 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3bcfc692-fd84-456e-8ec4-fbb8c8e08b6d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:31.629452 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3bcfc692-fd84-456e-8ec4-fbb8c8e08b6d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:31.629944 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3bcfc692-fd84-456e-8ec4-fbb8c8e08b6d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:31.877303 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3bcfc692-fd84-456e-8ec4-fbb8c8e08b6d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:31.886661 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3bcfc692-fd84-456e-8ec4-fbb8c8e08b6d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1769 microversion: 2.1 time: 0.277064 Jan 15 02:50:31.887253 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 456/950] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:31 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1769 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:39.785438 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-143e1bd8-237a-445e-bd3a-d16d2bec7965 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:39.785993 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-143e1bd8-237a-445e-bd3a-d16d2bec7965 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:39.793919 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-143e1bd8-237a-445e-bd3a-d16d2bec7965 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:39.794431 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-143e1bd8-237a-445e-bd3a-d16d2bec7965 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:39.795264 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-143e1bd8-237a-445e-bd3a-d16d2bec7965 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:39.795764 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-143e1bd8-237a-445e-bd3a-d16d2bec7965 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:39.868006 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-143e1bd8-237a-445e-bd3a-d16d2bec7965 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Going to try to terminate instance {{(pid=94111) delete /opt/stack/nova/nova/compute/api.py:2535}} Jan 15 02:50:39.984135 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-143e1bd8-237a-445e-bd3a-d16d2bec7965 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "DELETE /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 204 len: 0 microversion: 2.1 time: 0.207915 Jan 15 02:50:39.984814 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 495/951] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:50:39 2021] DELETE /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 02:50:39.998569 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-023df60a-af25-4a0e-84f4-6eec2713b6c8 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:39.999768 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-023df60a-af25-4a0e-84f4-6eec2713b6c8 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:40.007662 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-023df60a-af25-4a0e-84f4-6eec2713b6c8 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:40.008166 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-023df60a-af25-4a0e-84f4-6eec2713b6c8 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:40.009023 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-023df60a-af25-4a0e-84f4-6eec2713b6c8 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:40.009506 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-023df60a-af25-4a0e-84f4-6eec2713b6c8 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:40.255508 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-023df60a-af25-4a0e-84f4-6eec2713b6c8 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:40.264356 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-023df60a-af25-4a0e-84f4-6eec2713b6c8 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 200 len: 1584 microversion: 2.1 time: 0.275057 Jan 15 02:50:40.265580 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 457/952] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:39 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 1584 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:41.290720 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e3077a3f-1c10-4da2-acb1-4895d86f9cbc tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:41.291501 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e3077a3f-1c10-4da2-acb1-4895d86f9cbc tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:41.300503 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e3077a3f-1c10-4da2-acb1-4895d86f9cbc tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:41.301029 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e3077a3f-1c10-4da2-acb1-4895d86f9cbc tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:41.301885 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e3077a3f-1c10-4da2-acb1-4895d86f9cbc tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:41.302380 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e3077a3f-1c10-4da2-acb1-4895d86f9cbc tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:41.551002 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e3077a3f-1c10-4da2-acb1-4895d86f9cbc tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:41.560006 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e3077a3f-1c10-4da2-acb1-4895d86f9cbc tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 200 len: 1584 microversion: 2.1 time: 0.279865 Jan 15 02:50:41.560608 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 496/953] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:41 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 1584 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:42.584402 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-74b5bfc0-4993-4d6a-9310-72c470893a2a tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:42.585014 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-74b5bfc0-4993-4d6a-9310-72c470893a2a tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:42.593685 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-74b5bfc0-4993-4d6a-9310-72c470893a2a tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:42.594200 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-74b5bfc0-4993-4d6a-9310-72c470893a2a tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:42.595040 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-74b5bfc0-4993-4d6a-9310-72c470893a2a tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:42.595540 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-74b5bfc0-4993-4d6a-9310-72c470893a2a tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:42.853937 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-74b5bfc0-4993-4d6a-9310-72c470893a2a tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:42.863874 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-74b5bfc0-4993-4d6a-9310-72c470893a2a tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 200 len: 1584 microversion: 2.1 time: 0.289383 Jan 15 02:50:42.864465 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 458/954] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:42 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 1584 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:43.790077 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-76e28173-6311-4e40-aded-9894da880b6f req-46dafc91-fe44-4c5e-8b18-900931255e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883232af-b44d-4667-a346-099139fb27ea", "name": "network-vif-deleted", "tag": "0e3ce2a7-84eb-48d9-9129-f341c2f9f662"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:50:43.797197 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:50:43.797197 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:50:43.806761 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-76e28173-6311-4e40-aded-9894da880b6f req-46dafc91-fe44-4c5e-8b18-900931255e6b service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:43.807270 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-76e28173-6311-4e40-aded-9894da880b6f req-46dafc91-fe44-4c5e-8b18-900931255e6b service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:43.826032 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-76e28173-6311-4e40-aded-9894da880b6f req-46dafc91-fe44-4c5e-8b18-900931255e6b service nova] Creating event network-vif-deleted:0e3ce2a7-84eb-48d9-9129-f341c2f9f662 for instance 883232af-b44d-4667-a346-099139fb27ea on hv-cinder-76330 Jan 15 02:50:43.832200 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-76e28173-6311-4e40-aded-9894da880b6f req-46dafc91-fe44-4c5e-8b18-900931255e6b service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226705 Jan 15 02:50:43.832828 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 497/955] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:50:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:50:43.888172 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e23b890b-adc1-40e4-811a-edd169e97dca tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:43.888826 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e23b890b-adc1-40e4-811a-edd169e97dca tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:43.897853 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e23b890b-adc1-40e4-811a-edd169e97dca tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:43.898371 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e23b890b-adc1-40e4-811a-edd169e97dca tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:43.899225 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e23b890b-adc1-40e4-811a-edd169e97dca tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:43.899972 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e23b890b-adc1-40e4-811a-edd169e97dca tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:44.269560 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e23b890b-adc1-40e4-811a-edd169e97dca tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:44.279153 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e23b890b-adc1-40e4-811a-edd169e97dca tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 200 len: 1224 microversion: 2.1 time: 0.400088 Jan 15 02:50:44.279775 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 459/956] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:43 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 1224 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:45.305405 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3055956a-065a-43d9-a9ac-fe9d04bc4b8d tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:45.306119 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3055956a-065a-43d9-a9ac-fe9d04bc4b8d tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:45.315017 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3055956a-065a-43d9-a9ac-fe9d04bc4b8d tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:45.315571 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3055956a-065a-43d9-a9ac-fe9d04bc4b8d tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:45.316381 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3055956a-065a-43d9-a9ac-fe9d04bc4b8d tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:45.316868 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3055956a-065a-43d9-a9ac-fe9d04bc4b8d tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:45.376355 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-3055956a-065a-43d9-a9ac-fe9d04bc4b8d tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] HTTP exception thrown: Instance 883232af-b44d-4667-a346-099139fb27ea could not be found. Jan 15 02:50:45.376943 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3055956a-065a-43d9-a9ac-fe9d04bc4b8d tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Returning 404 to user: Instance 883232af-b44d-4667-a346-099139fb27ea could not be found. {{(pid=94111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:50:45.377914 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3055956a-065a-43d9-a9ac-fe9d04bc4b8d tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 404 len: 111 microversion: 2.1 time: 0.083766 Jan 15 02:50:45.378537 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 498/957] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:45 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:50:45.504609 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b44dd7c6-1dde-4e81-8b5d-5c367ebf8933 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-157217989", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-875881786", "security_groups": [{"name": "tempest-TestVolumeBootPattern-1449679234"}], "block_device_mapping_v2": [{"uuid": "b9457018-0724-41eb-9e9c-16d3aee314b0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "66972a8b-9a9e-409f-92ab-ee571d05c923"}]}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:50:45.696113 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-b44dd7c6-1dde-4e81-8b5d-5c367ebf8933 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] validate_networks() for [('66972a8b-9a9e-409f-92ab-ee571d05c923', None, None, None)] {{(pid=94112) validate_networks /opt/stack/nova/nova/network/neutron.py:2340}} Jan 15 02:50:46.417394 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-b44dd7c6-1dde-4e81-8b5d-5c367ebf8933 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Flavor limits 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 02:50:46.417879 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-b44dd7c6-1dde-4e81-8b5d-5c367ebf8933 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Image limits 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Jan 15 02:50:46.418376 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-b44dd7c6-1dde-4e81-8b5d-5c367ebf8933 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Flavor pref 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 02:50:46.418827 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-b44dd7c6-1dde-4e81-8b5d-5c367ebf8933 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Image pref 0:0:0 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Jan 15 02:50:46.419285 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-b44dd7c6-1dde-4e81-8b5d-5c367ebf8933 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Jan 15 02:50:46.428071 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b44dd7c6-1dde-4e81-8b5d-5c367ebf8933 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:46.428574 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b44dd7c6-1dde-4e81-8b5d-5c367ebf8933 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:46.429477 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b44dd7c6-1dde-4e81-8b5d-5c367ebf8933 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:46.429968 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b44dd7c6-1dde-4e81-8b5d-5c367ebf8933 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:46.448212 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-b44dd7c6-1dde-4e81-8b5d-5c367ebf8933 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Getting quotas for project a605fa30d830427db71d8178d5db456e. Resources: {'ram', 'instances', 'cores'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:50:46.453045 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-b44dd7c6-1dde-4e81-8b5d-5c367ebf8933 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Getting quotas for user 1e4528fe6b5a429688aeb5edbbf328e2 and project a605fa30d830427db71d8178d5db456e. Resources: {'ram', 'instances', 'cores'} {{(pid=94112) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:50:46.560583 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b44dd7c6-1dde-4e81-8b5d-5c367ebf8933 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Going to run 1 instances... {{(pid=94112) _provision_instances /opt/stack/nova/nova/compute/api.py:1263}} Jan 15 02:50:46.563604 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b44dd7c6-1dde-4e81-8b5d-5c367ebf8933 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b9457018-0724-41eb-9e9c-16d3aee314b0',volume_size=None,volume_type=None)] {{(pid=94112) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1661}} Jan 15 02:50:46.748237 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b44dd7c6-1dde-4e81-8b5d-5c367ebf8933 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [afede4e2-1677-4ac7-8fbf-ab55ad963d63] AMQP server on 10.222.0.37:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 02:50:47.764455 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO oslo.messaging._drivers.impl_rabbit [None req-b44dd7c6-1dde-4e81-8b5d-5c367ebf8933 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [afede4e2-1677-4ac7-8fbf-ab55ad963d63] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 50184. Jan 15 02:50:47.769755 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b44dd7c6-1dde-4e81-8b5d-5c367ebf8933 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 413 microversion: 2.1 time: 2.274659 Jan 15 02:50:47.770469 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 460/958] 10.222.0.37 () {60 vars in 1137 bytes} [Fri Jan 15 02:50:45 2021] POST /compute/v2.1/servers => generated 413 bytes in 2276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 02:50:47.787556 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e82a44df-2358-4357-9744-9057ee4e4ecf tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:47.789108 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e82a44df-2358-4357-9744-9057ee4e4ecf tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:47.892705 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e82a44df-2358-4357-9744-9057ee4e4ecf tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:47.901121 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e82a44df-2358-4357-9744-9057ee4e4ecf tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f" status: 200 len: 1093 microversion: 2.1 time: 0.123428 Jan 15 02:50:47.901699 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 499/959] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:47 2021] GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f => generated 1093 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:48.926587 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-dc63e5f1-3200-4f99-90d9-6d42ed3bb181 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:48.927155 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-dc63e5f1-3200-4f99-90d9-6d42ed3bb181 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:48.935325 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dc63e5f1-3200-4f99-90d9-6d42ed3bb181 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:48.935890 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dc63e5f1-3200-4f99-90d9-6d42ed3bb181 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:48.936902 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dc63e5f1-3200-4f99-90d9-6d42ed3bb181 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:48.937472 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dc63e5f1-3200-4f99-90d9-6d42ed3bb181 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:49.071498 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-dc63e5f1-3200-4f99-90d9-6d42ed3bb181 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:49.080836 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-dc63e5f1-3200-4f99-90d9-6d42ed3bb181 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f" status: 200 len: 1191 microversion: 2.1 time: 0.164742 Jan 15 02:50:49.081548 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 461/960] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:48 2021] GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f => generated 1191 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:50.105332 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-72e2f06b-bb51-4eb2-80f9-ab536e09e937 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:50.105987 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-72e2f06b-bb51-4eb2-80f9-ab536e09e937 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:50.114846 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-72e2f06b-bb51-4eb2-80f9-ab536e09e937 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:50.115336 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-72e2f06b-bb51-4eb2-80f9-ab536e09e937 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:50.116433 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-72e2f06b-bb51-4eb2-80f9-ab536e09e937 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:50.116977 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-72e2f06b-bb51-4eb2-80f9-ab536e09e937 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:50.563587 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-72e2f06b-bb51-4eb2-80f9-ab536e09e937 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:50.573032 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-72e2f06b-bb51-4eb2-80f9-ab536e09e937 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f" status: 200 len: 1284 microversion: 2.1 time: 0.476905 Jan 15 02:50:50.573844 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 500/961] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:50 2021] GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f => generated 1284 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:51.598311 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e1d6f32a-6bda-4a24-ab39-c87289cd9fc7 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:51.599050 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e1d6f32a-6bda-4a24-ab39-c87289cd9fc7 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:51.607250 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e1d6f32a-6bda-4a24-ab39-c87289cd9fc7 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:51.607992 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e1d6f32a-6bda-4a24-ab39-c87289cd9fc7 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:51.608878 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e1d6f32a-6bda-4a24-ab39-c87289cd9fc7 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:51.609395 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e1d6f32a-6bda-4a24-ab39-c87289cd9fc7 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:51.866142 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-46c67aa0-bfca-43b0-8271-b807e45b2135 req-e6121c0b-60c7-4bb0-b176-5af77069c088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0469523-c4e6-4c17-8065-db8feebb991f", "tag": "339825d0-35e4-4eaf-b676-07b400132d16"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:50:51.868896 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e1d6f32a-6bda-4a24-ab39-c87289cd9fc7 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:51.875263 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:50:51.875263 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:50:51.879851 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e1d6f32a-6bda-4a24-ab39-c87289cd9fc7 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f" status: 200 len: 1272 microversion: 2.1 time: 0.291698 Jan 15 02:50:51.880669 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 462/962] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:51 2021] GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f => generated 1272 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:51.885187 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-46c67aa0-bfca-43b0-8271-b807e45b2135 req-e6121c0b-60c7-4bb0-b176-5af77069c088 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:51.885898 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-46c67aa0-bfca-43b0-8271-b807e45b2135 req-e6121c0b-60c7-4bb0-b176-5af77069c088 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:51.906945 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-46c67aa0-bfca-43b0-8271-b807e45b2135 req-e6121c0b-60c7-4bb0-b176-5af77069c088 service nova] Creating event network-changed:339825d0-35e4-4eaf-b676-07b400132d16 for instance f0469523-c4e6-4c17-8065-db8feebb991f on hv-cinder-76330 Jan 15 02:50:51.912367 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-46c67aa0-bfca-43b0-8271-b807e45b2135 req-e6121c0b-60c7-4bb0-b176-5af77069c088 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059454 Jan 15 02:50:51.913213 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 501/963] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:50:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:50:52.905107 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b6af044a-20fc-4a5e-80b2-4cd41f4dde58 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:52.905782 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b6af044a-20fc-4a5e-80b2-4cd41f4dde58 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:52.914059 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b6af044a-20fc-4a5e-80b2-4cd41f4dde58 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:52.914555 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b6af044a-20fc-4a5e-80b2-4cd41f4dde58 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:52.915406 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b6af044a-20fc-4a5e-80b2-4cd41f4dde58 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:52.915894 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b6af044a-20fc-4a5e-80b2-4cd41f4dde58 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:53.161228 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b6af044a-20fc-4a5e-80b2-4cd41f4dde58 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:53.170163 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b6af044a-20fc-4a5e-80b2-4cd41f4dde58 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f" status: 200 len: 1272 microversion: 2.1 time: 0.275019 Jan 15 02:50:53.170793 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 463/964] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:52 2021] GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f => generated 1272 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:54.194550 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-4b6e642a-c076-4dfb-802c-6367efcd8132 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:54.195329 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-4b6e642a-c076-4dfb-802c-6367efcd8132 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:54.203700 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4b6e642a-c076-4dfb-802c-6367efcd8132 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:54.204213 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4b6e642a-c076-4dfb-802c-6367efcd8132 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:54.205067 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4b6e642a-c076-4dfb-802c-6367efcd8132 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:54.205567 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-4b6e642a-c076-4dfb-802c-6367efcd8132 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:54.470596 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-4b6e642a-c076-4dfb-802c-6367efcd8132 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:54.480046 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-4b6e642a-c076-4dfb-802c-6367efcd8132 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f" status: 200 len: 1272 microversion: 2.1 time: 0.295345 Jan 15 02:50:54.480643 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 502/965] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:54 2021] GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f => generated 1272 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:55.505165 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ae86cd91-0699-4304-93f3-1996cc6590e6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:55.505835 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ae86cd91-0699-4304-93f3-1996cc6590e6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:55.513750 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ae86cd91-0699-4304-93f3-1996cc6590e6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:55.514262 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ae86cd91-0699-4304-93f3-1996cc6590e6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:55.515587 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ae86cd91-0699-4304-93f3-1996cc6590e6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:55.516090 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ae86cd91-0699-4304-93f3-1996cc6590e6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:55.759840 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-ae86cd91-0699-4304-93f3-1996cc6590e6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:55.768803 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ae86cd91-0699-4304-93f3-1996cc6590e6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f" status: 200 len: 1272 microversion: 2.1 time: 0.273847 Jan 15 02:50:55.769434 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 464/966] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:55 2021] GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f => generated 1272 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:56.793797 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f2e64c7b-a6c2-4aff-91c4-0e5c67ee0c02 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:56.794572 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f2e64c7b-a6c2-4aff-91c4-0e5c67ee0c02 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:56.803148 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f2e64c7b-a6c2-4aff-91c4-0e5c67ee0c02 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:56.803657 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f2e64c7b-a6c2-4aff-91c4-0e5c67ee0c02 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:56.804494 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f2e64c7b-a6c2-4aff-91c4-0e5c67ee0c02 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:56.804984 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f2e64c7b-a6c2-4aff-91c4-0e5c67ee0c02 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:57.042974 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f2e64c7b-a6c2-4aff-91c4-0e5c67ee0c02 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:57.052373 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f2e64c7b-a6c2-4aff-91c4-0e5c67ee0c02 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f" status: 200 len: 1272 microversion: 2.1 time: 0.268847 Jan 15 02:50:57.052952 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 503/967] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:56 2021] GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f => generated 1272 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:58.076361 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d1b3078b-94fb-4b87-945e-7e3d5c92950c tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:58.077148 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d1b3078b-94fb-4b87-945e-7e3d5c92950c tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:58.085561 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d1b3078b-94fb-4b87-945e-7e3d5c92950c tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:58.086062 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d1b3078b-94fb-4b87-945e-7e3d5c92950c tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:58.086884 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d1b3078b-94fb-4b87-945e-7e3d5c92950c tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:58.087366 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d1b3078b-94fb-4b87-945e-7e3d5c92950c tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:58.332287 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d1b3078b-94fb-4b87-945e-7e3d5c92950c tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:58.341108 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d1b3078b-94fb-4b87-945e-7e3d5c92950c tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f" status: 200 len: 1272 microversion: 2.1 time: 0.273851 Jan 15 02:50:58.341903 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 465/968] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:58 2021] GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f => generated 1272 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:50:59.363770 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-013e2790-0bbf-4e88-a9df-ae1f1996a918 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:50:59.364435 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-013e2790-0bbf-4e88-a9df-ae1f1996a918 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:50:59.372309 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-013e2790-0bbf-4e88-a9df-ae1f1996a918 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:59.372813 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-013e2790-0bbf-4e88-a9df-ae1f1996a918 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:59.374406 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-013e2790-0bbf-4e88-a9df-ae1f1996a918 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:50:59.374895 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-013e2790-0bbf-4e88-a9df-ae1f1996a918 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:50:59.616474 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-013e2790-0bbf-4e88-a9df-ae1f1996a918 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:50:59.626251 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-013e2790-0bbf-4e88-a9df-ae1f1996a918 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f" status: 200 len: 1272 microversion: 2.1 time: 0.271977 Jan 15 02:50:59.626848 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 504/969] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:50:59 2021] GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f => generated 1272 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:51:00.650468 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-3c0a0ebf-0342-427d-9c22-52e4ead610d2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:51:00.651147 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-3c0a0ebf-0342-427d-9c22-52e4ead610d2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:51:00.660226 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3c0a0ebf-0342-427d-9c22-52e4ead610d2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:00.660744 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3c0a0ebf-0342-427d-9c22-52e4ead610d2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:00.661624 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3c0a0ebf-0342-427d-9c22-52e4ead610d2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:00.662127 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-3c0a0ebf-0342-427d-9c22-52e4ead610d2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:00.910243 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-3c0a0ebf-0342-427d-9c22-52e4ead610d2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:51:00.919575 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-3c0a0ebf-0342-427d-9c22-52e4ead610d2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f" status: 200 len: 1272 microversion: 2.1 time: 0.278868 Jan 15 02:51:00.920173 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 466/970] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:51:00 2021] GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f => generated 1272 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:51:01.501118 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aa0ae05f-7c54-44bd-bd7f-f4a66ecdee23] AMQP server on 10.222.0.37:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 15 02:51:01.540360 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-fc09eecc-09ad-44b0-8cd2-465a2a546982 req-f28a1142-ab1b-4825-81e7-309131d6db0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0469523-c4e6-4c17-8065-db8feebb991f", "name": "network-vif-plugged", "status": "completed", "tag": "339825d0-35e4-4eaf-b676-07b400132d16"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:51:01.548212 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:51:01.548212 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:51:01.557187 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-fc09eecc-09ad-44b0-8cd2-465a2a546982 req-f28a1142-ab1b-4825-81e7-309131d6db0f service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:01.557693 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-fc09eecc-09ad-44b0-8cd2-465a2a546982 req-f28a1142-ab1b-4825-81e7-309131d6db0f service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:01.575865 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-fc09eecc-09ad-44b0-8cd2-465a2a546982 req-f28a1142-ab1b-4825-81e7-309131d6db0f service nova] Creating event network-vif-plugged:339825d0-35e4-4eaf-b676-07b400132d16 for instance f0469523-c4e6-4c17-8065-db8feebb991f on hv-cinder-76330 Jan 15 02:51:01.581483 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-fc09eecc-09ad-44b0-8cd2-465a2a546982 req-f28a1142-ab1b-4825-81e7-309131d6db0f service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138661 Jan 15 02:51:01.582124 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 505/971] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:51:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:51:01.943254 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7ebb7964-15d5-4e7e-a7b0-dd8ca27711cf tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:51:01.943936 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-7ebb7964-15d5-4e7e-a7b0-dd8ca27711cf tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:51:01.951858 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7ebb7964-15d5-4e7e-a7b0-dd8ca27711cf tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:01.952372 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7ebb7964-15d5-4e7e-a7b0-dd8ca27711cf tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:01.953253 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7ebb7964-15d5-4e7e-a7b0-dd8ca27711cf tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:01.953752 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7ebb7964-15d5-4e7e-a7b0-dd8ca27711cf tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:02.194684 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-7ebb7964-15d5-4e7e-a7b0-dd8ca27711cf tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:51:02.204692 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-7ebb7964-15d5-4e7e-a7b0-dd8ca27711cf tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f" status: 200 len: 1272 microversion: 2.1 time: 0.270755 Jan 15 02:51:02.205379 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 467/972] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:51:01 2021] GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f => generated 1272 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:51:03.240705 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-8585315f-1886-4e06-85e0-12d849de1486 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:51:03.241425 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8585315f-1886-4e06-85e0-12d849de1486 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:51:03.250844 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8585315f-1886-4e06-85e0-12d849de1486 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:03.251438 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8585315f-1886-4e06-85e0-12d849de1486 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:03.252240 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8585315f-1886-4e06-85e0-12d849de1486 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:03.253789 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8585315f-1886-4e06-85e0-12d849de1486 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:03.289105 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO oslo.messaging._drivers.impl_rabbit [-] [aa0ae05f-7c54-44bd-bd7f-f4a66ecdee23] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 50230. Jan 15 02:51:03.498629 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-8585315f-1886-4e06-85e0-12d849de1486 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:51:03.508073 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-8585315f-1886-4e06-85e0-12d849de1486 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f" status: 200 len: 1459 microversion: 2.1 time: 0.288292 Jan 15 02:51:03.508690 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 506/973] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:51:03 2021] GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f => generated 1459 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:51:03.533475 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-446a9c30-129a-44ed-8337-5198cacc2101 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:51:03.534184 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-446a9c30-129a-44ed-8337-5198cacc2101 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:51:03.542324 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-446a9c30-129a-44ed-8337-5198cacc2101 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:03.542837 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-446a9c30-129a-44ed-8337-5198cacc2101 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:03.543725 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-446a9c30-129a-44ed-8337-5198cacc2101 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:03.544221 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-446a9c30-129a-44ed-8337-5198cacc2101 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:03.843647 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-446a9c30-129a-44ed-8337-5198cacc2101 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:51:03.853049 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-446a9c30-129a-44ed-8337-5198cacc2101 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f" status: 200 len: 1459 microversion: 2.1 time: 0.330319 Jan 15 02:51:03.853688 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 468/974] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:51:03 2021] GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f => generated 1459 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:51:03.877584 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-73fb8805-a865-4edd-814f-ada2f0208fb7 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Action: 'create', calling method: .version_select at 0x7f878f17c598>, body: {"pool": null} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:51:04.466237 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-11e6036e-3fca-474c-99ef-b70035141cc1 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-TestMinimumBasicScenario-2049868195"}} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:51:04.466827 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-11e6036e-3fca-474c-99ef-b70035141cc1 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:51:04.475194 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-11e6036e-3fca-474c-99ef-b70035141cc1 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:04.475696 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-11e6036e-3fca-474c-99ef-b70035141cc1 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:04.477050 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-11e6036e-3fca-474c-99ef-b70035141cc1 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:04.477557 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-11e6036e-3fca-474c-99ef-b70035141cc1 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:04.746977 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 02:51:04.747315 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: Fri Jan 15 02:51:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-floating-ips (ip 10.222.0.37) !!! Jan 15 02:51:04.788153 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.network.security_group_api [None req-11e6036e-3fca-474c-99ef-b70035141cc1 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Removing security group 9e0ce083-6b2d-4062-b534-9d1d9fb2579e from port 052f801e-5017-44ed-970e-8d35ccd4f7f0 Jan 15 02:51:05.657750 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-11e6036e-3fca-474c-99ef-b70035141cc1 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "POST /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d/action" status: 202 len: 0 microversion: 2.1 time: 1.200998 Jan 15 02:51:05.662186 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 469/975] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:51:04 2021] POST /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d/action => generated 0 bytes in 1206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:51:05.675785 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ded7c7b0-f9fe-48b6-9679-70a6b4263ef6 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '.version_select at 0x7f878e78b488>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:51:05.977730 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ded7c7b0-f9fe-48b6-9679-70a6b4263ef6 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "DELETE /compute/v2.1/os-security-groups/9e0ce083-6b2d-4062-b534-9d1d9fb2579e" status: 202 len: 0 microversion: 2.1 time: 0.314085 Jan 15 02:51:05.978363 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 470/976] 10.222.0.37 () {58 vars in 1262 bytes} [Fri Jan 15 02:51:05 2021] DELETE /compute/v2.1/os-security-groups/9e0ce083-6b2d-4062-b534-9d1d9fb2579e => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:51:06.083278 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-84732085-c5f4-4916-9411-f68d6e99a29d req-079f2698-698d-49ab-b7e0-c5c7019a8e21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2b63947-dd66-4609-984f-d991ce567e3d", "tag": "052f801e-5017-44ed-970e-8d35ccd4f7f0"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:51:06.090125 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:51:06.090125 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:51:06.100236 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-84732085-c5f4-4916-9411-f68d6e99a29d req-079f2698-698d-49ab-b7e0-c5c7019a8e21 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:06.100747 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-84732085-c5f4-4916-9411-f68d6e99a29d req-079f2698-698d-49ab-b7e0-c5c7019a8e21 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:06.119161 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-84732085-c5f4-4916-9411-f68d6e99a29d req-079f2698-698d-49ab-b7e0-c5c7019a8e21 service nova] Creating event network-changed:052f801e-5017-44ed-970e-8d35ccd4f7f0 for instance f2b63947-dd66-4609-984f-d991ce567e3d on hv-cinder-76330 Jan 15 02:51:06.125345 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-84732085-c5f4-4916-9411-f68d6e99a29d req-079f2698-698d-49ab-b7e0-c5c7019a8e21 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145167 Jan 15 02:51:06.126030 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 471/977] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:51:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:51:06.136962 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-1400a2b8-74d3-4e81-8794-3bc4b7fa0e14 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '.version_select at 0x7f8790258ea0>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:51:06.137498 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-73fb8805-a865-4edd-814f-ada2f0208fb7 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.269765 Jan 15 02:51:06.138270 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 507/978] 10.222.0.37 () {60 vars in 1160 bytes} [Fri Jan 15 02:51:03 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:51:06.156244 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f2fe2f11-b515-41f2-99bb-022de6c943ea tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.1.18"}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:51:06.157582 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f2fe2f11-b515-41f2-99bb-022de6c943ea tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:51:06.166871 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f2fe2f11-b515-41f2-99bb-022de6c943ea tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:06.167378 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f2fe2f11-b515-41f2-99bb-022de6c943ea tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:06.168278 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f2fe2f11-b515-41f2-99bb-022de6c943ea tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:06.168753 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f2fe2f11-b515-41f2-99bb-022de6c943ea tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:06.245451 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f2fe2f11-b515-41f2-99bb-022de6c943ea tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Acquired lock "refresh_cache-f0469523-c4e6-4c17-8065-db8feebb991f" {{(pid=94111) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Jan 15 02:51:06.722810 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-1400a2b8-74d3-4e81-8794-3bc4b7fa0e14 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:51:06.739019 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1400a2b8-74d3-4e81-8794-3bc4b7fa0e14 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:06.739913 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1400a2b8-74d3-4e81-8794-3bc4b7fa0e14 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:06.741761 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1400a2b8-74d3-4e81-8794-3bc4b7fa0e14 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:06.742909 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1400a2b8-74d3-4e81-8794-3bc4b7fa0e14 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:06.830679 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1400a2b8-74d3-4e81-8794-3bc4b7fa0e14 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Acquired lock "refresh_cache-f2b63947-dd66-4609-984f-d991ce567e3d" {{(pid=94112) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Jan 15 02:51:08.937802 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-1400a2b8-74d3-4e81-8794-3bc4b7fa0e14 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Building network info cache for instance {{(pid=94112) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1831}} Jan 15 02:51:09.649482 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-f2fe2f11-b515-41f2-99bb-022de6c943ea tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Building network info cache for instance {{(pid=94111) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1831}} Jan 15 02:51:09.871758 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-1400a2b8-74d3-4e81-8794-3bc4b7fa0e14 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Updating instance_info_cache with network_info: [{"id": "052f801e-5017-44ed-970e-8d35ccd4f7f0", "address": "fa:16:3e:63:14:e5", "network": {"id": "aa41af28-86fc-4815-807c-954e9b8d1655", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-926942052-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3c221fae580744f08ab966c3fb47ca29", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap052f801e-50", "ovs_interfaceid": "052f801e-5017-44ed-970e-8d35ccd4f7f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94112) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Jan 15 02:51:09.886645 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-1400a2b8-74d3-4e81-8794-3bc4b7fa0e14 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Releasing lock "refresh_cache-f2b63947-dd66-4609-984f-d991ce567e3d" {{(pid=94112) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Jan 15 02:51:09.888247 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-1400a2b8-74d3-4e81-8794-3bc4b7fa0e14 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "DELETE /compute/v2.1/os-floating-ips/a6707531-dc72-4b61-8932-610c81676fd6" status: 202 len: 0 microversion: 2.1 time: 3.761041 Jan 15 02:51:09.889859 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 472/979] 10.222.0.37 () {58 vars in 1253 bytes} [Fri Jan 15 02:51:06 2021] DELETE /compute/v2.1/os-floating-ips/a6707531-dc72-4b61-8932-610c81676fd6 => generated 0 bytes in 3763 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:51:09.901568 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-d8b5cf05-b64b-4ee4-9a62-67cdddffe33d req-4f6c5573-7988-4960-825d-6c52057ca2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2b63947-dd66-4609-984f-d991ce567e3d", "tag": "052f801e-5017-44ed-970e-8d35ccd4f7f0"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:51:09.909682 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:51:09.909682 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:51:09.921351 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-d8b5cf05-b64b-4ee4-9a62-67cdddffe33d req-4f6c5573-7988-4960-825d-6c52057ca2e8 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:09.922124 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-d8b5cf05-b64b-4ee4-9a62-67cdddffe33d req-4f6c5573-7988-4960-825d-6c52057ca2e8 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:09.945534 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-d8b5cf05-b64b-4ee4-9a62-67cdddffe33d req-4f6c5573-7988-4960-825d-6c52057ca2e8 service nova] Creating event network-changed:052f801e-5017-44ed-970e-8d35ccd4f7f0 for instance f2b63947-dd66-4609-984f-d991ce567e3d on hv-cinder-76330 Jan 15 02:51:09.954537 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-d8b5cf05-b64b-4ee4-9a62-67cdddffe33d req-4f6c5573-7988-4960-825d-6c52057ca2e8 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062096 Jan 15 02:51:09.956044 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 473/980] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:51:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:51:09.972303 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-d77b7056-0c27-4c8f-9ad1-02e90e06fe83 req-e0628598-8c2a-4ebe-9b17-147b74c09045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0469523-c4e6-4c17-8065-db8feebb991f", "tag": "339825d0-35e4-4eaf-b676-07b400132d16"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:51:09.981138 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:51:09.981138 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:51:09.993060 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-d77b7056-0c27-4c8f-9ad1-02e90e06fe83 req-e0628598-8c2a-4ebe-9b17-147b74c09045 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:09.993931 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-d77b7056-0c27-4c8f-9ad1-02e90e06fe83 req-e0628598-8c2a-4ebe-9b17-147b74c09045 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:10.023368 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-d77b7056-0c27-4c8f-9ad1-02e90e06fe83 req-e0628598-8c2a-4ebe-9b17-147b74c09045 service nova] Creating event network-changed:339825d0-35e4-4eaf-b676-07b400132d16 for instance f0469523-c4e6-4c17-8065-db8feebb991f on hv-cinder-76330 Jan 15 02:51:10.031376 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-d77b7056-0c27-4c8f-9ad1-02e90e06fe83 req-e0628598-8c2a-4ebe-9b17-147b74c09045 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072083 Jan 15 02:51:10.033114 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 474/981] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:51:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:51:10.046091 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-c5bffa48-8347-45a6-89cb-278cef9b395a tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:51:10.046762 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-c5bffa48-8347-45a6-89cb-278cef9b395a tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:51:10.056565 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c5bffa48-8347-45a6-89cb-278cef9b395a tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:10.057132 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c5bffa48-8347-45a6-89cb-278cef9b395a tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:10.068392 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c5bffa48-8347-45a6-89cb-278cef9b395a tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:10.068916 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-c5bffa48-8347-45a6-89cb-278cef9b395a tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:10.506194 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-c5bffa48-8347-45a6-89cb-278cef9b395a tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "DELETE /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d/os-volume_attachments/5a4d25c7-a881-46a7-950c-d51461f5cf34" status: 202 len: 0 microversion: 2.1 time: 0.470760 Jan 15 02:51:10.507754 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 475/982] 10.222.0.37 () {58 vars in 1406 bytes} [Fri Jan 15 02:51:10 2021] DELETE /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d/os-volume_attachments/5a4d25c7-a881-46a7-950c-d51461f5cf34 => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:51:10.537519 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a951cfe1-8492-47ec-b29a-1b4c44574ef5 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:51:10.538898 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a951cfe1-8492-47ec-b29a-1b4c44574ef5 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:51:10.548840 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a951cfe1-8492-47ec-b29a-1b4c44574ef5 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:10.549390 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a951cfe1-8492-47ec-b29a-1b4c44574ef5 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:10.550264 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a951cfe1-8492-47ec-b29a-1b4c44574ef5 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:10.550766 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a951cfe1-8492-47ec-b29a-1b4c44574ef5 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:10.723401 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a951cfe1-8492-47ec-b29a-1b4c44574ef5 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.207701 Jan 15 02:51:10.728610 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 476/983] 10.222.0.37 () {58 vars in 1292 bytes} [Fri Jan 15 02:51:10 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d/os-volume_attachments => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:51:11.346102 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-f2fe2f11-b515-41f2-99bb-022de6c943ea tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Updating instance_info_cache with network_info: [{"id": "339825d0-35e4-4eaf-b676-07b400132d16", "address": "fa:16:3e:46:eb:fe", "network": {"id": "66972a8b-9a9e-409f-92ab-ee571d05c923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1406902355-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.1.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a605fa30d830427db71d8178d5db456e", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap339825d0-35", "ovs_interfaceid": "339825d0-35e4-4eaf-b676-07b400132d16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94111) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Jan 15 02:51:11.355046 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f2fe2f11-b515-41f2-99bb-022de6c943ea tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Releasing lock "refresh_cache-f0469523-c4e6-4c17-8065-db8feebb991f" {{(pid=94111) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Jan 15 02:51:11.355959 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f2fe2f11-b515-41f2-99bb-022de6c943ea tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "POST /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f/action" status: 202 len: 0 microversion: 2.1 time: 5.209600 Jan 15 02:51:11.356807 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 508/984] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:51:06 2021] POST /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f/action => generated 0 bytes in 5211 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jan 15 02:51:11.742934 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-935ee0fc-e177-4624-9da4-9c573cceb655 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:51:11.744122 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-935ee0fc-e177-4624-9da4-9c573cceb655 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:51:11.752836 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-935ee0fc-e177-4624-9da4-9c573cceb655 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:11.753479 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-935ee0fc-e177-4624-9da4-9c573cceb655 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:11.754422 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-935ee0fc-e177-4624-9da4-9c573cceb655 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:11.755003 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-935ee0fc-e177-4624-9da4-9c573cceb655 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:11.832464 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-935ee0fc-e177-4624-9da4-9c573cceb655 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099967 Jan 15 02:51:11.833056 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 477/985] 10.222.0.37 () {58 vars in 1292 bytes} [Fri Jan 15 02:51:11 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 02:51:11.850860 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-982a0c61-4d8a-4778-b91a-0c40f18994fe tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:51:11.851411 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-982a0c61-4d8a-4778-b91a-0c40f18994fe tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:51:11.859739 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-982a0c61-4d8a-4778-b91a-0c40f18994fe tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:11.860239 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-982a0c61-4d8a-4778-b91a-0c40f18994fe tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:11.861109 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-982a0c61-4d8a-4778-b91a-0c40f18994fe tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:11.861602 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-982a0c61-4d8a-4778-b91a-0c40f18994fe tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:12.037941 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-982a0c61-4d8a-4778-b91a-0c40f18994fe tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] HTTP exception thrown: Instance f2b63947-dd66-4609-984f-d991ce567e3d is not attached to volume 5a4d25c7-a881-46a7-950c-d51461f5cf34 Jan 15 02:51:12.038624 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-982a0c61-4d8a-4778-b91a-0c40f18994fe tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Returning 404 to user: Instance f2b63947-dd66-4609-984f-d991ce567e3d is not attached to volume 5a4d25c7-a881-46a7-950c-d51461f5cf34 {{(pid=94111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:51:12.039532 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-982a0c61-4d8a-4778-b91a-0c40f18994fe tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "DELETE /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d/os-volume_attachments/5a4d25c7-a881-46a7-950c-d51461f5cf34" status: 404 len: 154 microversion: 2.1 time: 0.199400 Jan 15 02:51:12.040157 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 509/986] 10.222.0.37 () {58 vars in 1406 bytes} [Fri Jan 15 02:51:11 2021] DELETE /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d/os-volume_attachments/5a4d25c7-a881-46a7-950c-d51461f5cf34 => generated 154 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:51:13.308314 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-dbe24694-6055-4669-947e-699be3498810 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:51:13.308903 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-dbe24694-6055-4669-947e-699be3498810 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:51:13.319383 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dbe24694-6055-4669-947e-699be3498810 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:13.319906 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dbe24694-6055-4669-947e-699be3498810 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:13.320768 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dbe24694-6055-4669-947e-699be3498810 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:13.321299 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-dbe24694-6055-4669-947e-699be3498810 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:13.408857 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-dbe24694-6055-4669-947e-699be3498810 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Going to try to terminate instance {{(pid=94112) delete /opt/stack/nova/nova/compute/api.py:2535}} Jan 15 02:51:13.542268 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-dbe24694-6055-4669-947e-699be3498810 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "DELETE /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 204 len: 0 microversion: 2.1 time: 0.244846 Jan 15 02:51:13.543209 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 478/987] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:51:13 2021] DELETE /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 02:51:13.558517 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e94fe906-8789-42cc-bbbd-186c4d496b92 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:51:13.559201 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e94fe906-8789-42cc-bbbd-186c4d496b92 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:51:13.568191 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e94fe906-8789-42cc-bbbd-186c4d496b92 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:13.568701 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e94fe906-8789-42cc-bbbd-186c4d496b92 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:13.569594 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e94fe906-8789-42cc-bbbd-186c4d496b92 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:13.570096 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e94fe906-8789-42cc-bbbd-186c4d496b92 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:13.827640 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-e94fe906-8789-42cc-bbbd-186c4d496b92 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:51:13.836891 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e94fe906-8789-42cc-bbbd-186c4d496b92 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1553 microversion: 2.1 time: 0.287926 Jan 15 02:51:13.837529 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 510/988] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:51:13 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1553 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:51:14.863012 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-429203c4-40c0-4ca9-b04d-a85aea2a6f45 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:51:14.863798 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-429203c4-40c0-4ca9-b04d-a85aea2a6f45 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:51:14.871814 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-429203c4-40c0-4ca9-b04d-a85aea2a6f45 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:14.872333 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-429203c4-40c0-4ca9-b04d-a85aea2a6f45 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:14.873252 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-429203c4-40c0-4ca9-b04d-a85aea2a6f45 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:14.873773 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-429203c4-40c0-4ca9-b04d-a85aea2a6f45 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:15.162353 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-429203c4-40c0-4ca9-b04d-a85aea2a6f45 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:51:15.171668 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-429203c4-40c0-4ca9-b04d-a85aea2a6f45 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1553 microversion: 2.1 time: 0.318673 Jan 15 02:51:15.172290 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 479/989] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:51:14 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1553 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:51:16.196763 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a3e57892-6aa2-4cd6-bd5a-a58092048168 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:51:16.197487 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a3e57892-6aa2-4cd6-bd5a-a58092048168 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:51:16.206685 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a3e57892-6aa2-4cd6-bd5a-a58092048168 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:16.207191 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a3e57892-6aa2-4cd6-bd5a-a58092048168 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:16.208040 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a3e57892-6aa2-4cd6-bd5a-a58092048168 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:16.208534 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a3e57892-6aa2-4cd6-bd5a-a58092048168 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:16.740290 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a3e57892-6aa2-4cd6-bd5a-a58092048168 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccdcc0a6e044a53ad931d652d4c7bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c221fae580744f08ab966c3fb47ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:51:16.758672 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a3e57892-6aa2-4cd6-bd5a-a58092048168 tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 200 len: 1553 microversion: 2.1 time: 0.570651 Jan 15 02:51:16.759700 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 511/990] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:51:16 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 1553 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:51:16.975073 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-29ebabed-1135-4b7f-a703-2ab74fbff979 req-3ab5e3ba-1966-4c12-a8cb-3c1fe1f8ec2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b63947-dd66-4609-984f-d991ce567e3d", "name": "network-vif-deleted", "tag": "052f801e-5017-44ed-970e-8d35ccd4f7f0"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:51:16.981963 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:51:16.981963 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:51:16.991826 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-29ebabed-1135-4b7f-a703-2ab74fbff979 req-3ab5e3ba-1966-4c12-a8cb-3c1fe1f8ec2d service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:16.992327 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-29ebabed-1135-4b7f-a703-2ab74fbff979 req-3ab5e3ba-1966-4c12-a8cb-3c1fe1f8ec2d service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:17.011865 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-29ebabed-1135-4b7f-a703-2ab74fbff979 req-3ab5e3ba-1966-4c12-a8cb-3c1fe1f8ec2d service nova] Creating event network-vif-deleted:052f801e-5017-44ed-970e-8d35ccd4f7f0 for instance f2b63947-dd66-4609-984f-d991ce567e3d on hv-cinder-76330 Jan 15 02:51:17.016878 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-29ebabed-1135-4b7f-a703-2ab74fbff979 req-3ab5e3ba-1966-4c12-a8cb-3c1fe1f8ec2d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051204 Jan 15 02:51:17.017574 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 480/991] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:51:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:51:17.793673 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e059c7ab-d100-418b-a488-3b36bc1a128d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:51:17.794343 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-e059c7ab-d100-418b-a488-3b36bc1a128d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] [instance: f2b63947-dd66-4609-984f-d991ce567e3d] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:51:17.802491 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e059c7ab-d100-418b-a488-3b36bc1a128d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:17.803003 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e059c7ab-d100-418b-a488-3b36bc1a128d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:17.803845 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e059c7ab-d100-418b-a488-3b36bc1a128d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:51:17.804336 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-e059c7ab-d100-418b-a488-3b36bc1a128d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:51:17.857555 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-e059c7ab-d100-418b-a488-3b36bc1a128d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] HTTP exception thrown: Instance f2b63947-dd66-4609-984f-d991ce567e3d could not be found. Jan 15 02:51:17.858218 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-e059c7ab-d100-418b-a488-3b36bc1a128d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Returning 404 to user: Instance f2b63947-dd66-4609-984f-d991ce567e3d could not be found. {{(pid=94111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:51:17.859112 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-e059c7ab-d100-418b-a488-3b36bc1a128d tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d" status: 404 len: 111 microversion: 2.1 time: 0.075063 Jan 15 02:51:17.859714 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 512/992] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:51:17 2021] GET /compute/v2.1/servers/f2b63947-dd66-4609-984f-d991ce567e3d => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:51:17.875184 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ca0f5a61-e566-45e7-a971-a6070bf7ca8e tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] Calling method '.version_select at 0x7f878e7428c8>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:51:17.899608 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ca0f5a61-e566-45e7-a971-a6070bf7ca8e tempest-TestMinimumBasicScenario-1510755625 tempest-TestMinimumBasicScenario-1510755625] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1572793650" status: 202 len: 0 microversion: 2.1 time: 0.034315 Jan 15 02:51:17.900493 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 481/993] 10.222.0.37 () {58 vars in 1262 bytes} [Fri Jan 15 02:51:17 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1572793650 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:52:29.620372 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 02:52:29.620989 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: Fri Jan 15 02:52:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 02:52:57.074835 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-82021370-2ce0-4b86-87ab-c19a7f03e7d6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-324373762", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-875881786", "security_groups": [{"name": "tempest-TestVolumeBootPattern-1449679234"}], "block_device_mapping_v2": [{"uuid": "5d390e87-021d-481d-8593-8b769ad9e0f4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "66972a8b-9a9e-409f-92ab-ee571d05c923"}]}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:52:57.266906 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-82021370-2ce0-4b86-87ab-c19a7f03e7d6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] validate_networks() for [('66972a8b-9a9e-409f-92ab-ee571d05c923', None, None, None)] {{(pid=94111) validate_networks /opt/stack/nova/nova/network/neutron.py:2340}} Jan 15 02:52:57.893020 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-82021370-2ce0-4b86-87ab-c19a7f03e7d6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Flavor limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 02:52:57.893531 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-82021370-2ce0-4b86-87ab-c19a7f03e7d6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Image limits 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Jan 15 02:52:57.894078 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-82021370-2ce0-4b86-87ab-c19a7f03e7d6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Flavor pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 02:52:57.895041 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-82021370-2ce0-4b86-87ab-c19a7f03e7d6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Image pref 0:0:0 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Jan 15 02:52:57.895493 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.virt.hardware [None req-82021370-2ce0-4b86-87ab-c19a7f03e7d6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Jan 15 02:52:57.904807 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-82021370-2ce0-4b86-87ab-c19a7f03e7d6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:52:57.905372 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-82021370-2ce0-4b86-87ab-c19a7f03e7d6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:52:57.906253 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-82021370-2ce0-4b86-87ab-c19a7f03e7d6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:52:57.906754 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-82021370-2ce0-4b86-87ab-c19a7f03e7d6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:52:57.926127 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-82021370-2ce0-4b86-87ab-c19a7f03e7d6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Getting quotas for project a605fa30d830427db71d8178d5db456e. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:388}} Jan 15 02:52:57.930815 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.quota [None req-82021370-2ce0-4b86-87ab-c19a7f03e7d6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Getting quotas for user 1e4528fe6b5a429688aeb5edbbf328e2 and project a605fa30d830427db71d8178d5db456e. Resources: {'ram', 'instances', 'cores'} {{(pid=94111) _get_quotas /opt/stack/nova/nova/quota.py:380}} Jan 15 02:52:58.037741 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-82021370-2ce0-4b86-87ab-c19a7f03e7d6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Going to run 1 instances... {{(pid=94111) _provision_instances /opt/stack/nova/nova/compute/api.py:1263}} Jan 15 02:52:58.040148 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-82021370-2ce0-4b86-87ab-c19a7f03e7d6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5d390e87-021d-481d-8593-8b769ad9e0f4',volume_size=None,volume_type=None)] {{(pid=94111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1661}} Jan 15 02:52:58.214996 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-82021370-2ce0-4b86-87ab-c19a7f03e7d6 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 413 microversion: 2.1 time: 1.149591 Jan 15 02:52:58.216481 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 513/994] 10.222.0.37 () {60 vars in 1137 bytes} [Fri Jan 15 02:52:57 2021] POST /compute/v2.1/servers => generated 413 bytes in 1151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 02:52:58.224436 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: ERROR oslo.messaging._drivers.impl_rabbit [-] [211e210f-deca-4f6b-aac8-fd3fea79cd82] AMQP server on 10.222.0.37:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 02:52:58.234325 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-89d92062-5a33-4c6c-876d-634d35e60c92 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:52:58.235447 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-89d92062-5a33-4c6c-876d-634d35e60c92 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:52:58.324949 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-89d92062-5a33-4c6c-876d-634d35e60c92 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:52:58.333919 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-89d92062-5a33-4c6c-876d-634d35e60c92 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef" status: 200 len: 1093 microversion: 2.1 time: 0.111255 Jan 15 02:52:58.334549 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 482/995] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:52:58 2021] GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef => generated 1093 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:52:59.358412 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7962a823-6dcb-46db-9066-ca16bfaeb08b tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:52:59.359072 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-7962a823-6dcb-46db-9066-ca16bfaeb08b tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:52:59.368451 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7962a823-6dcb-46db-9066-ca16bfaeb08b tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:52:59.368974 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7962a823-6dcb-46db-9066-ca16bfaeb08b tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:52:59.369935 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7962a823-6dcb-46db-9066-ca16bfaeb08b tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:52:59.370443 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7962a823-6dcb-46db-9066-ca16bfaeb08b tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:52:59.548585 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-7962a823-6dcb-46db-9066-ca16bfaeb08b tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:52:59.558688 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-7962a823-6dcb-46db-9066-ca16bfaeb08b tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef" status: 200 len: 1209 microversion: 2.1 time: 0.210819 Jan 15 02:52:59.564835 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 514/996] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:52:59 2021] GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef => generated 1209 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:53:00.593997 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-09f55266-b39c-44ce-b373-8e1c2ac437f1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:53:00.594654 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-09f55266-b39c-44ce-b373-8e1c2ac437f1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:53:00.606034 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-09f55266-b39c-44ce-b373-8e1c2ac437f1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:00.606552 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-09f55266-b39c-44ce-b373-8e1c2ac437f1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:00.607413 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-09f55266-b39c-44ce-b373-8e1c2ac437f1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:00.607913 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-09f55266-b39c-44ce-b373-8e1c2ac437f1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:00.679063 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO oslo.messaging._drivers.impl_rabbit [-] [211e210f-deca-4f6b-aac8-fd3fea79cd82] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 50436. Jan 15 02:53:00.895986 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-09f55266-b39c-44ce-b373-8e1c2ac437f1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:53:00.911150 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-09f55266-b39c-44ce-b373-8e1c2ac437f1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef" status: 200 len: 1272 microversion: 2.1 time: 0.336872 Jan 15 02:53:00.912045 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 483/997] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:53:00 2021] GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef => generated 1272 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:53:01.935993 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-102ce184-5947-430a-8b88-12f474d505a7 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:53:01.936598 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-102ce184-5947-430a-8b88-12f474d505a7 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:53:01.945037 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-102ce184-5947-430a-8b88-12f474d505a7 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:01.945560 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-102ce184-5947-430a-8b88-12f474d505a7 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:01.946414 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-102ce184-5947-430a-8b88-12f474d505a7 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:01.946908 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-102ce184-5947-430a-8b88-12f474d505a7 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:02.133601 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-d0ab9e89-54bd-49bc-89e3-b0b27086c07b req-616293f4-1457-4a11-8478-73f629246fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "491455db-6277-40d7-8950-d9ecfbfff1ef", "tag": "d85cceb4-bb40-41b1-b05d-229cf7a031fe"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:53:02.141649 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:53:02.141649 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:53:02.159820 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-d0ab9e89-54bd-49bc-89e3-b0b27086c07b req-616293f4-1457-4a11-8478-73f629246fb1 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:02.161307 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-d0ab9e89-54bd-49bc-89e3-b0b27086c07b req-616293f4-1457-4a11-8478-73f629246fb1 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:02.181201 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-d0ab9e89-54bd-49bc-89e3-b0b27086c07b req-616293f4-1457-4a11-8478-73f629246fb1 service nova] Creating event network-changed:d85cceb4-bb40-41b1-b05d-229cf7a031fe for instance 491455db-6277-40d7-8950-d9ecfbfff1ef on hv-cinder-76330 Jan 15 02:53:02.186403 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-d0ab9e89-54bd-49bc-89e3-b0b27086c07b req-616293f4-1457-4a11-8478-73f629246fb1 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064152 Jan 15 02:53:02.187204 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 484/998] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:53:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:53:02.560406 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-102ce184-5947-430a-8b88-12f474d505a7 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:53:02.570647 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-102ce184-5947-430a-8b88-12f474d505a7 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef" status: 200 len: 1272 microversion: 2.1 time: 0.644758 Jan 15 02:53:02.571254 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 515/999] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:53:01 2021] GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef => generated 1272 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:53:03.594144 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a4bd9aaf-9076-429a-8e97-e7aef2943ff5 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:53:03.594924 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-a4bd9aaf-9076-429a-8e97-e7aef2943ff5 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:53:03.603868 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a4bd9aaf-9076-429a-8e97-e7aef2943ff5 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:03.604380 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a4bd9aaf-9076-429a-8e97-e7aef2943ff5 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:03.605265 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a4bd9aaf-9076-429a-8e97-e7aef2943ff5 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:03.605769 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-a4bd9aaf-9076-429a-8e97-e7aef2943ff5 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:03.867193 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-a4bd9aaf-9076-429a-8e97-e7aef2943ff5 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:53:03.876654 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a4bd9aaf-9076-429a-8e97-e7aef2943ff5 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef" status: 200 len: 1272 microversion: 2.1 time: 0.292196 Jan 15 02:53:03.877553 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 485/1000] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:53:03 2021] GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef => generated 1272 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:53:04.900965 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ebcf82db-93b9-4416-a405-9dc5e9df8b69 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:53:04.901677 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ebcf82db-93b9-4416-a405-9dc5e9df8b69 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:53:04.909568 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ebcf82db-93b9-4416-a405-9dc5e9df8b69 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:04.910080 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ebcf82db-93b9-4416-a405-9dc5e9df8b69 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:04.911468 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ebcf82db-93b9-4416-a405-9dc5e9df8b69 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:04.912505 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ebcf82db-93b9-4416-a405-9dc5e9df8b69 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:05.155232 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-ebcf82db-93b9-4416-a405-9dc5e9df8b69 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:53:05.164981 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ebcf82db-93b9-4416-a405-9dc5e9df8b69 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef" status: 200 len: 1272 microversion: 2.1 time: 0.274033 Jan 15 02:53:05.165607 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 516/1001] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:53:04 2021] GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef => generated 1272 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:53:06.189042 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d0eaa0c1-215e-4087-8fd8-74c7e8fe24b3 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:53:06.189706 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d0eaa0c1-215e-4087-8fd8-74c7e8fe24b3 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:53:06.198302 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d0eaa0c1-215e-4087-8fd8-74c7e8fe24b3 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:06.198809 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d0eaa0c1-215e-4087-8fd8-74c7e8fe24b3 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:06.199643 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d0eaa0c1-215e-4087-8fd8-74c7e8fe24b3 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:06.200140 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d0eaa0c1-215e-4087-8fd8-74c7e8fe24b3 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:06.445292 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d0eaa0c1-215e-4087-8fd8-74c7e8fe24b3 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:53:06.454064 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d0eaa0c1-215e-4087-8fd8-74c7e8fe24b3 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef" status: 200 len: 1272 microversion: 2.1 time: 0.274233 Jan 15 02:53:06.454656 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 486/1002] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:53:06 2021] GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef => generated 1272 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:53:07.478971 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ecd06d42-6d07-4539-9984-10c52a349837 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:53:07.479646 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ecd06d42-6d07-4539-9984-10c52a349837 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:53:07.487725 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ecd06d42-6d07-4539-9984-10c52a349837 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:07.488231 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ecd06d42-6d07-4539-9984-10c52a349837 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:07.489878 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ecd06d42-6d07-4539-9984-10c52a349837 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:07.490841 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ecd06d42-6d07-4539-9984-10c52a349837 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:07.796317 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-ecd06d42-6d07-4539-9984-10c52a349837 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:53:07.806192 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ecd06d42-6d07-4539-9984-10c52a349837 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef" status: 200 len: 1272 microversion: 2.1 time: 0.338135 Jan 15 02:53:07.807077 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 517/1003] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:53:07 2021] GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef => generated 1272 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:53:08.830039 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-716fa8fa-2dba-4ac5-8f4d-e4fa3c2be461 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:53:08.830631 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-716fa8fa-2dba-4ac5-8f4d-e4fa3c2be461 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:53:08.840968 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-716fa8fa-2dba-4ac5-8f4d-e4fa3c2be461 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:08.841499 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-716fa8fa-2dba-4ac5-8f4d-e4fa3c2be461 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:08.842347 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-716fa8fa-2dba-4ac5-8f4d-e4fa3c2be461 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:08.842838 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-716fa8fa-2dba-4ac5-8f4d-e4fa3c2be461 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:09.091853 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-716fa8fa-2dba-4ac5-8f4d-e4fa3c2be461 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:53:09.101735 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-716fa8fa-2dba-4ac5-8f4d-e4fa3c2be461 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef" status: 200 len: 1272 microversion: 2.1 time: 0.281678 Jan 15 02:53:09.102342 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 487/1004] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:53:08 2021] GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef => generated 1272 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:53:10.125374 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-5f413b0d-909e-4823-a5b2-87efcefd4fe4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:53:10.126041 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-5f413b0d-909e-4823-a5b2-87efcefd4fe4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:53:10.134066 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5f413b0d-909e-4823-a5b2-87efcefd4fe4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:10.134631 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5f413b0d-909e-4823-a5b2-87efcefd4fe4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:10.135408 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5f413b0d-909e-4823-a5b2-87efcefd4fe4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:10.136137 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-5f413b0d-909e-4823-a5b2-87efcefd4fe4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:10.387601 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-5f413b0d-909e-4823-a5b2-87efcefd4fe4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:53:10.397325 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-5f413b0d-909e-4823-a5b2-87efcefd4fe4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef" status: 200 len: 1272 microversion: 2.1 time: 0.281091 Jan 15 02:53:10.398559 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 518/1005] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:53:10 2021] GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef => generated 1272 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:53:10.822770 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-0bb65282-c332-4949-8adb-adef74e75df8 req-2f1bd6df-b806-4b85-9400-15f2d088f51e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "491455db-6277-40d7-8950-d9ecfbfff1ef", "name": "network-vif-plugged", "status": "completed", "tag": "d85cceb4-bb40-41b1-b05d-229cf7a031fe"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:53:10.829792 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:53:10.829792 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:53:10.838918 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-0bb65282-c332-4949-8adb-adef74e75df8 req-2f1bd6df-b806-4b85-9400-15f2d088f51e service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:10.839417 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-0bb65282-c332-4949-8adb-adef74e75df8 req-2f1bd6df-b806-4b85-9400-15f2d088f51e service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:10.858272 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-0bb65282-c332-4949-8adb-adef74e75df8 req-2f1bd6df-b806-4b85-9400-15f2d088f51e service nova] Creating event network-vif-plugged:d85cceb4-bb40-41b1-b05d-229cf7a031fe for instance 491455db-6277-40d7-8950-d9ecfbfff1ef on hv-cinder-76330 Jan 15 02:53:10.863565 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-0bb65282-c332-4949-8adb-adef74e75df8 req-2f1bd6df-b806-4b85-9400-15f2d088f51e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051861 Jan 15 02:53:10.865725 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 488/1006] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:53:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:53:11.422430 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-78eb5a0a-ae6a-4e25-b5be-2b737397b4c1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:53:11.423108 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-78eb5a0a-ae6a-4e25-b5be-2b737397b4c1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:53:11.431404 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-78eb5a0a-ae6a-4e25-b5be-2b737397b4c1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:11.431856 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-78eb5a0a-ae6a-4e25-b5be-2b737397b4c1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:11.432730 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-78eb5a0a-ae6a-4e25-b5be-2b737397b4c1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:11.433255 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-78eb5a0a-ae6a-4e25-b5be-2b737397b4c1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:11.682420 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-78eb5a0a-ae6a-4e25-b5be-2b737397b4c1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:53:11.691477 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-78eb5a0a-ae6a-4e25-b5be-2b737397b4c1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef" status: 200 len: 1272 microversion: 2.1 time: 0.278331 Jan 15 02:53:11.692083 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 519/1007] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:53:11 2021] GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef => generated 1272 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:53:12.716968 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-fe28eb16-bc04-4dc3-9dcd-e196d2260522 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:53:12.717771 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-fe28eb16-bc04-4dc3-9dcd-e196d2260522 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:53:12.730395 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fe28eb16-bc04-4dc3-9dcd-e196d2260522 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:12.730903 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fe28eb16-bc04-4dc3-9dcd-e196d2260522 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:12.731749 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fe28eb16-bc04-4dc3-9dcd-e196d2260522 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:12.732241 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-fe28eb16-bc04-4dc3-9dcd-e196d2260522 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:12.981022 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-fe28eb16-bc04-4dc3-9dcd-e196d2260522 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:53:12.990770 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-fe28eb16-bc04-4dc3-9dcd-e196d2260522 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef" status: 200 len: 1459 microversion: 2.1 time: 0.284216 Jan 15 02:53:12.991372 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 489/1008] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:53:12 2021] GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef => generated 1459 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:53:13.013943 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-ccb6eac6-d5d9-46c7-9751-398698c87fae tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:53:13.014618 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-ccb6eac6-d5d9-46c7-9751-398698c87fae tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:53:13.022685 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ccb6eac6-d5d9-46c7-9751-398698c87fae tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:13.023192 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ccb6eac6-d5d9-46c7-9751-398698c87fae tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:13.024044 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ccb6eac6-d5d9-46c7-9751-398698c87fae tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:13.024542 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-ccb6eac6-d5d9-46c7-9751-398698c87fae tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:13.268989 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-ccb6eac6-d5d9-46c7-9751-398698c87fae tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:53:13.278378 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-ccb6eac6-d5d9-46c7-9751-398698c87fae tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef" status: 200 len: 1459 microversion: 2.1 time: 0.274230 Jan 15 02:53:13.278968 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 520/1009] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:53:13 2021] GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef => generated 1459 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:53:13.302718 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-2496e29e-451f-42c2-bf6c-eae5c7fe9863 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Action: 'create', calling method: .version_select at 0x7f878e742950>, body: {"pool": null} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:53:15.765774 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-2496e29e-451f-42c2-bf6c-eae5c7fe9863 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.473022 Jan 15 02:53:15.766429 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 490/1010] 10.222.0.37 () {60 vars in 1160 bytes} [Fri Jan 15 02:53:13 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:53:15.784617 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-129dd2e6-cda1-4fc3-9399-94a77885c3bc tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.1.72"}} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:53:15.786609 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-129dd2e6-cda1-4fc3-9399-94a77885c3bc tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:53:15.794751 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-129dd2e6-cda1-4fc3-9399-94a77885c3bc tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:15.795259 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-129dd2e6-cda1-4fc3-9399-94a77885c3bc tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:15.796171 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-129dd2e6-cda1-4fc3-9399-94a77885c3bc tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:15.796841 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-129dd2e6-cda1-4fc3-9399-94a77885c3bc tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:15.873095 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-129dd2e6-cda1-4fc3-9399-94a77885c3bc tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Acquired lock "refresh_cache-491455db-6277-40d7-8950-d9ecfbfff1ef" {{(pid=94111) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Jan 15 02:53:17.828058 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-129dd2e6-cda1-4fc3-9399-94a77885c3bc tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Building network info cache for instance {{(pid=94111) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1831}} Jan 15 02:53:17.843227 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-cf25c219-6fc6-4a9a-b100-df26cee01f71 req-24f0c719-9ea2-4678-885d-5a2202188294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "491455db-6277-40d7-8950-d9ecfbfff1ef", "tag": "d85cceb4-bb40-41b1-b05d-229cf7a031fe"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:53:17.851411 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:53:17.851411 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:53:17.861396 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-cf25c219-6fc6-4a9a-b100-df26cee01f71 req-24f0c719-9ea2-4678-885d-5a2202188294 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:53:17.862019 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-cf25c219-6fc6-4a9a-b100-df26cee01f71 req-24f0c719-9ea2-4678-885d-5a2202188294 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:53:17.881167 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-cf25c219-6fc6-4a9a-b100-df26cee01f71 req-24f0c719-9ea2-4678-885d-5a2202188294 service nova] Creating event network-changed:d85cceb4-bb40-41b1-b05d-229cf7a031fe for instance 491455db-6277-40d7-8950-d9ecfbfff1ef on hv-cinder-76330 Jan 15 02:53:17.886640 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-cf25c219-6fc6-4a9a-b100-df26cee01f71 req-24f0c719-9ea2-4678-885d-5a2202188294 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053226 Jan 15 02:53:17.887667 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 491/1011] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:53:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:53:19.441434 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-129dd2e6-cda1-4fc3-9399-94a77885c3bc tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Updating instance_info_cache with network_info: [{"id": "d85cceb4-bb40-41b1-b05d-229cf7a031fe", "address": "fa:16:3e:db:96:ee", "network": {"id": "66972a8b-9a9e-409f-92ab-ee571d05c923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1406902355-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.1.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a605fa30d830427db71d8178d5db456e", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapd85cceb4-bb", "ovs_interfaceid": "d85cceb4-bb40-41b1-b05d-229cf7a031fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94111) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Jan 15 02:53:19.454644 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-129dd2e6-cda1-4fc3-9399-94a77885c3bc tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Releasing lock "refresh_cache-491455db-6277-40d7-8950-d9ecfbfff1ef" {{(pid=94111) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Jan 15 02:53:19.457204 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-129dd2e6-cda1-4fc3-9399-94a77885c3bc tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "POST /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef/action" status: 202 len: 0 microversion: 2.1 time: 3.682539 Jan 15 02:53:19.458145 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 521/1012] 10.222.0.37 () {60 vars in 1268 bytes} [Fri Jan 15 02:53:15 2021] POST /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef/action => generated 0 bytes in 3684 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jan 15 02:54:17.259776 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 02:54:17.260377 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: Fri Jan 15 02:54:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 02:54:24.768389 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 02:54:24.768966 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: Fri Jan 15 02:54:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 02:54:39.115181 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-35e2457a-ff13-4e6b-a3b4-b48b88f655f2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '.version_select at 0x7f878f072ae8>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:54:39.886660 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-35e2457a-ff13-4e6b-a3b4-b48b88f655f2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:54:39.894887 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-35e2457a-ff13-4e6b-a3b4-b48b88f655f2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:39.895395 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-35e2457a-ff13-4e6b-a3b4-b48b88f655f2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:39.896238 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-35e2457a-ff13-4e6b-a3b4-b48b88f655f2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:39.897344 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-35e2457a-ff13-4e6b-a3b4-b48b88f655f2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:39.962979 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-35e2457a-ff13-4e6b-a3b4-b48b88f655f2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Acquired lock "refresh_cache-491455db-6277-40d7-8950-d9ecfbfff1ef" {{(pid=94112) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Jan 15 02:54:41.906742 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-35e2457a-ff13-4e6b-a3b4-b48b88f655f2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Building network info cache for instance {{(pid=94112) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1831}} Jan 15 02:54:41.921728 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-87fb4483-97d4-4c99-aad3-0f76b776a5b0 req-31f9e4be-c90a-42cd-a982-c20601794112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "491455db-6277-40d7-8950-d9ecfbfff1ef", "tag": "d85cceb4-bb40-41b1-b05d-229cf7a031fe"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:54:41.929555 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:54:41.929555 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:54:41.935540 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aa0ae05f-7c54-44bd-bd7f-f4a66ecdee23] AMQP server on 10.222.0.37:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 15 02:54:41.939389 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-87fb4483-97d4-4c99-aad3-0f76b776a5b0 req-31f9e4be-c90a-42cd-a982-c20601794112 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:41.939887 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-87fb4483-97d4-4c99-aad3-0f76b776a5b0 req-31f9e4be-c90a-42cd-a982-c20601794112 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:41.958138 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-87fb4483-97d4-4c99-aad3-0f76b776a5b0 req-31f9e4be-c90a-42cd-a982-c20601794112 service nova] Creating event network-changed:d85cceb4-bb40-41b1-b05d-229cf7a031fe for instance 491455db-6277-40d7-8950-d9ecfbfff1ef on hv-cinder-76330 Jan 15 02:54:41.964083 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-87fb4483-97d4-4c99-aad3-0f76b776a5b0 req-31f9e4be-c90a-42cd-a982-c20601794112 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052265 Jan 15 02:54:41.964871 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 522/1013] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:54:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:54:42.709780 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-35e2457a-ff13-4e6b-a3b4-b48b88f655f2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Updating instance_info_cache with network_info: [{"id": "d85cceb4-bb40-41b1-b05d-229cf7a031fe", "address": "fa:16:3e:db:96:ee", "network": {"id": "66972a8b-9a9e-409f-92ab-ee571d05c923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1406902355-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a605fa30d830427db71d8178d5db456e", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapd85cceb4-bb", "ovs_interfaceid": "d85cceb4-bb40-41b1-b05d-229cf7a031fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94112) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Jan 15 02:54:42.723006 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-35e2457a-ff13-4e6b-a3b4-b48b88f655f2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Releasing lock "refresh_cache-491455db-6277-40d7-8950-d9ecfbfff1ef" {{(pid=94112) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Jan 15 02:54:42.724012 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-35e2457a-ff13-4e6b-a3b4-b48b88f655f2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "DELETE /compute/v2.1/os-floating-ips/c404cba3-e37f-4794-b367-b5374a34365a" status: 202 len: 0 microversion: 2.1 time: 3.618650 Jan 15 02:54:42.728820 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 492/1014] 10.222.0.37 () {58 vars in 1253 bytes} [Fri Jan 15 02:54:39 2021] DELETE /compute/v2.1/os-floating-ips/c404cba3-e37f-4794-b367-b5374a34365a => generated 0 bytes in 3621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:54:42.741347 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-68ccd930-4f62-421a-affd-ed136147fc8c tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:54:42.742029 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-68ccd930-4f62-421a-affd-ed136147fc8c tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:54:42.750404 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-68ccd930-4f62-421a-affd-ed136147fc8c tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:42.751173 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-68ccd930-4f62-421a-affd-ed136147fc8c tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:42.752186 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-68ccd930-4f62-421a-affd-ed136147fc8c tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:42.752838 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-68ccd930-4f62-421a-affd-ed136147fc8c tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:42.828992 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-68ccd930-4f62-421a-affd-ed136147fc8c tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Going to try to terminate instance {{(pid=94111) delete /opt/stack/nova/nova/compute/api.py:2535}} Jan 15 02:54:42.959885 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO oslo.messaging._drivers.impl_rabbit [-] [aa0ae05f-7c54-44bd-bd7f-f4a66ecdee23] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 50496. Jan 15 02:54:42.964930 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-68ccd930-4f62-421a-affd-ed136147fc8c tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "DELETE /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef" status: 204 len: 0 microversion: 2.1 time: 0.234007 Jan 15 02:54:42.965617 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 523/1015] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:54:42 2021] DELETE /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 02:54:42.979346 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b6bec2c9-4ca8-4d41-b2ce-409fc180b513 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:54:42.980020 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b6bec2c9-4ca8-4d41-b2ce-409fc180b513 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:54:42.987893 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b6bec2c9-4ca8-4d41-b2ce-409fc180b513 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:42.988403 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b6bec2c9-4ca8-4d41-b2ce-409fc180b513 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:42.989275 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b6bec2c9-4ca8-4d41-b2ce-409fc180b513 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:42.989768 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b6bec2c9-4ca8-4d41-b2ce-409fc180b513 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:43.252701 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b6bec2c9-4ca8-4d41-b2ce-409fc180b513 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:54:43.264446 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b6bec2c9-4ca8-4d41-b2ce-409fc180b513 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef" status: 200 len: 1465 microversion: 2.1 time: 0.294127 Jan 15 02:54:43.265105 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 493/1016] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:54:42 2021] GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef => generated 1465 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 02:54:44.292165 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-56fe0809-62d5-4bd2-9ee7-74e0f0659034 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:54:44.292946 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-56fe0809-62d5-4bd2-9ee7-74e0f0659034 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:54:44.305704 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-56fe0809-62d5-4bd2-9ee7-74e0f0659034 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:44.306325 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-56fe0809-62d5-4bd2-9ee7-74e0f0659034 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:44.307081 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-56fe0809-62d5-4bd2-9ee7-74e0f0659034 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:44.307583 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-56fe0809-62d5-4bd2-9ee7-74e0f0659034 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:44.630444 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-56fe0809-62d5-4bd2-9ee7-74e0f0659034 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:54:44.639623 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-56fe0809-62d5-4bd2-9ee7-74e0f0659034 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef" status: 200 len: 1465 microversion: 2.1 time: 0.357815 Jan 15 02:54:44.640228 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 524/1017] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:54:44 2021] GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef => generated 1465 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:54:45.160522 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-ae4c646c-c0b9-47d1-b0d3-e1bed87b6a1b req-7f490e38-6c81-4633-af24-e43cc3c53a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "491455db-6277-40d7-8950-d9ecfbfff1ef", "name": "network-vif-unplugged", "status": "completed", "tag": "d85cceb4-bb40-41b1-b05d-229cf7a031fe"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:54:45.168371 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:54:45.168371 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:54:45.178389 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-ae4c646c-c0b9-47d1-b0d3-e1bed87b6a1b req-7f490e38-6c81-4633-af24-e43cc3c53a4c service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:45.179077 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-ae4c646c-c0b9-47d1-b0d3-e1bed87b6a1b req-7f490e38-6c81-4633-af24-e43cc3c53a4c service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:45.197393 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-ae4c646c-c0b9-47d1-b0d3-e1bed87b6a1b req-7f490e38-6c81-4633-af24-e43cc3c53a4c service nova] Creating event network-vif-unplugged:d85cceb4-bb40-41b1-b05d-229cf7a031fe for instance 491455db-6277-40d7-8950-d9ecfbfff1ef on hv-cinder-76330 Jan 15 02:54:45.203724 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-ae4c646c-c0b9-47d1-b0d3-e1bed87b6a1b req-7f490e38-6c81-4633-af24-e43cc3c53a4c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052969 Jan 15 02:54:45.204549 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 494/1018] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:54:45 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:54:45.663967 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-455520d4-b440-4e3b-9c8e-56f535e5572e tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:54:45.664640 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-455520d4-b440-4e3b-9c8e-56f535e5572e tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:54:45.672641 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-455520d4-b440-4e3b-9c8e-56f535e5572e tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:45.673179 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-455520d4-b440-4e3b-9c8e-56f535e5572e tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:45.674022 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-455520d4-b440-4e3b-9c8e-56f535e5572e tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:45.674516 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-455520d4-b440-4e3b-9c8e-56f535e5572e tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:45.963564 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-455520d4-b440-4e3b-9c8e-56f535e5572e tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:54:45.972593 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-455520d4-b440-4e3b-9c8e-56f535e5572e tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef" status: 200 len: 1465 microversion: 2.1 time: 0.317753 Jan 15 02:54:45.973216 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 525/1019] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:54:45 2021] GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef => generated 1465 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:54:46.698592 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-6590e6e2-9b4f-4150-99cd-a37fc5ea111a req-13804566-b1c5-4bf5-b9e8-038721bfeb02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "491455db-6277-40d7-8950-d9ecfbfff1ef", "name": "network-vif-deleted", "tag": "d85cceb4-bb40-41b1-b05d-229cf7a031fe"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:54:46.705507 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:54:46.705507 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:54:46.715175 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-6590e6e2-9b4f-4150-99cd-a37fc5ea111a req-13804566-b1c5-4bf5-b9e8-038721bfeb02 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:46.715678 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-6590e6e2-9b4f-4150-99cd-a37fc5ea111a req-13804566-b1c5-4bf5-b9e8-038721bfeb02 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:46.735607 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-6590e6e2-9b4f-4150-99cd-a37fc5ea111a req-13804566-b1c5-4bf5-b9e8-038721bfeb02 service nova] Creating event network-vif-deleted:d85cceb4-bb40-41b1-b05d-229cf7a031fe for instance 491455db-6277-40d7-8950-d9ecfbfff1ef on hv-cinder-76330 Jan 15 02:54:46.740982 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-6590e6e2-9b4f-4150-99cd-a37fc5ea111a req-13804566-b1c5-4bf5-b9e8-038721bfeb02 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052658 Jan 15 02:54:46.741683 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 495/1020] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:54:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 02:54:46.997078 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-f1c6c674-b3d3-4941-9a42-6b8895d4651e tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:54:46.997647 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-f1c6c674-b3d3-4941-9a42-6b8895d4651e tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:54:47.005479 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f1c6c674-b3d3-4941-9a42-6b8895d4651e tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:47.006617 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f1c6c674-b3d3-4941-9a42-6b8895d4651e tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:47.007535 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f1c6c674-b3d3-4941-9a42-6b8895d4651e tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:47.008030 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-f1c6c674-b3d3-4941-9a42-6b8895d4651e tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:47.165172 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-f1c6c674-b3d3-4941-9a42-6b8895d4651e tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:54:47.174231 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-f1c6c674-b3d3-4941-9a42-6b8895d4651e tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef" status: 200 len: 1224 microversion: 2.1 time: 0.187004 Jan 15 02:54:47.174828 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 526/1021] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:54:46 2021] GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef => generated 1224 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:54:48.199568 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-65fca824-a715-468b-9df2-f6fd49375686 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:54:48.200329 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-65fca824-a715-468b-9df2-f6fd49375686 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 491455db-6277-40d7-8950-d9ecfbfff1ef] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:54:48.208463 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-65fca824-a715-468b-9df2-f6fd49375686 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:48.210025 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-65fca824-a715-468b-9df2-f6fd49375686 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:48.210858 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-65fca824-a715-468b-9df2-f6fd49375686 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:48.211372 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-65fca824-a715-468b-9df2-f6fd49375686 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:48.263396 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-65fca824-a715-468b-9df2-f6fd49375686 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] HTTP exception thrown: Instance 491455db-6277-40d7-8950-d9ecfbfff1ef could not be found. Jan 15 02:54:48.264056 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-65fca824-a715-468b-9df2-f6fd49375686 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Returning 404 to user: Instance 491455db-6277-40d7-8950-d9ecfbfff1ef could not be found. {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:54:48.264938 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-65fca824-a715-468b-9df2-f6fd49375686 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef" status: 404 len: 111 microversion: 2.1 time: 0.075305 Jan 15 02:54:48.265567 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 496/1022] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:54:48 2021] GET /compute/v2.1/servers/491455db-6277-40d7-8950-d9ecfbfff1ef => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:54:50.696283 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b8ba5c23-0848-4f07-8245-27779cb21298 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '.version_select at 0x7f878e6dad08>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:54:51.464820 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b8ba5c23-0848-4f07-8245-27779cb21298 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:54:51.477204 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b8ba5c23-0848-4f07-8245-27779cb21298 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:51.477712 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b8ba5c23-0848-4f07-8245-27779cb21298 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:51.478561 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b8ba5c23-0848-4f07-8245-27779cb21298 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:51.479047 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b8ba5c23-0848-4f07-8245-27779cb21298 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:51.541396 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b8ba5c23-0848-4f07-8245-27779cb21298 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Acquired lock "refresh_cache-f0469523-c4e6-4c17-8065-db8feebb991f" {{(pid=94111) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Jan 15 02:54:53.237099 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-b8ba5c23-0848-4f07-8245-27779cb21298 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Building network info cache for instance {{(pid=94111) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1831}} Jan 15 02:54:53.252642 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-d812f2f3-1efb-4ed3-8d9c-a81887a3196b req-c0fe0d9b-7775-41f8-86a2-ddd785e821fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0469523-c4e6-4c17-8065-db8feebb991f", "tag": "339825d0-35e4-4eaf-b676-07b400132d16"}]} {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:54:53.259806 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:54:53.259806 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:54:53.268843 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-d812f2f3-1efb-4ed3-8d9c-a81887a3196b req-c0fe0d9b-7775-41f8-86a2-ddd785e821fc service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:53.269454 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-d812f2f3-1efb-4ed3-8d9c-a81887a3196b req-c0fe0d9b-7775-41f8-86a2-ddd785e821fc service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:53.291656 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-d812f2f3-1efb-4ed3-8d9c-a81887a3196b req-c0fe0d9b-7775-41f8-86a2-ddd785e821fc service nova] Creating event network-changed:339825d0-35e4-4eaf-b676-07b400132d16 for instance f0469523-c4e6-4c17-8065-db8feebb991f on hv-cinder-76330 Jan 15 02:54:53.297102 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-d812f2f3-1efb-4ed3-8d9c-a81887a3196b req-c0fe0d9b-7775-41f8-86a2-ddd785e821fc service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054082 Jan 15 02:54:53.297943 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 497/1023] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:54:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:54:54.750687 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.network.neutron [None req-b8ba5c23-0848-4f07-8245-27779cb21298 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Updating instance_info_cache with network_info: [{"id": "339825d0-35e4-4eaf-b676-07b400132d16", "address": "fa:16:3e:46:eb:fe", "network": {"id": "66972a8b-9a9e-409f-92ab-ee571d05c923", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1406902355-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a605fa30d830427db71d8178d5db456e", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap339825d0-35", "ovs_interfaceid": "339825d0-35e4-4eaf-b676-07b400132d16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94111) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Jan 15 02:54:54.762428 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b8ba5c23-0848-4f07-8245-27779cb21298 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Releasing lock "refresh_cache-f0469523-c4e6-4c17-8065-db8feebb991f" {{(pid=94111) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Jan 15 02:54:54.763448 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b8ba5c23-0848-4f07-8245-27779cb21298 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "DELETE /compute/v2.1/os-floating-ips/2f011b6e-0ba4-4852-ba24-719a666c90fe" status: 202 len: 0 microversion: 2.1 time: 4.077229 Jan 15 02:54:54.764420 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 527/1024] 10.222.0.37 () {58 vars in 1253 bytes} [Fri Jan 15 02:54:50 2021] DELETE /compute/v2.1/os-floating-ips/2f011b6e-0ba4-4852-ba24-719a666c90fe => generated 0 bytes in 4078 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:54:54.780674 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-8af359d9-9f81-4e01-abd9-3b464c932e71 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:54:54.780970 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8af359d9-9f81-4e01-abd9-3b464c932e71 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:54:54.789639 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8af359d9-9f81-4e01-abd9-3b464c932e71 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:54.790486 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8af359d9-9f81-4e01-abd9-3b464c932e71 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:54.791429 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8af359d9-9f81-4e01-abd9-3b464c932e71 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:54.792001 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-8af359d9-9f81-4e01-abd9-3b464c932e71 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:54.865534 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-8af359d9-9f81-4e01-abd9-3b464c932e71 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Going to try to terminate instance {{(pid=94112) delete /opt/stack/nova/nova/compute/api.py:2535}} Jan 15 02:54:54.983402 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-8af359d9-9f81-4e01-abd9-3b464c932e71 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "DELETE /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f" status: 204 len: 0 microversion: 2.1 time: 0.213777 Jan 15 02:54:54.984118 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 498/1025] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:54:54 2021] DELETE /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 02:54:54.998607 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-7122fea9-a32c-416b-82e3-90cc734b3a59 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:54:54.999221 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-7122fea9-a32c-416b-82e3-90cc734b3a59 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:54:55.007825 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7122fea9-a32c-416b-82e3-90cc734b3a59 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:55.008363 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7122fea9-a32c-416b-82e3-90cc734b3a59 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:55.009224 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7122fea9-a32c-416b-82e3-90cc734b3a59 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:55.009721 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-7122fea9-a32c-416b-82e3-90cc734b3a59 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:55.269931 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-7122fea9-a32c-416b-82e3-90cc734b3a59 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94111) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:54:55.279110 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-7122fea9-a32c-416b-82e3-90cc734b3a59 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f" status: 200 len: 1465 microversion: 2.1 time: 0.290378 Jan 15 02:54:55.279708 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 528/1026] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:54:54 2021] GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f => generated 1465 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:54:56.305050 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-06f4dea3-740b-4c25-bde6-b686a81d867b tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:54:56.305834 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-06f4dea3-740b-4c25-bde6-b686a81d867b tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:54:56.313971 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-06f4dea3-740b-4c25-bde6-b686a81d867b tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:56.314482 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-06f4dea3-740b-4c25-bde6-b686a81d867b tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:56.315325 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-06f4dea3-740b-4c25-bde6-b686a81d867b tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:56.315844 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-06f4dea3-740b-4c25-bde6-b686a81d867b tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:56.557923 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-06f4dea3-740b-4c25-bde6-b686a81d867b tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:54:56.566850 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-06f4dea3-740b-4c25-bde6-b686a81d867b tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f" status: 200 len: 1465 microversion: 2.1 time: 0.272240 Jan 15 02:54:56.567446 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 499/1027] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:54:56 2021] GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f => generated 1465 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:54:57.305810 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-1504f8c5-f320-40f4-87ac-0239fb2cf1cf req-a7b70822-d678-4563-a929-4d7994a6a433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0469523-c4e6-4c17-8065-db8feebb991f", "name": "network-vif-unplugged", "status": "completed", "tag": "339825d0-35e4-4eaf-b676-07b400132d16"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:54:57.312788 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:54:57.312788 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:54:57.322451 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-1504f8c5-f320-40f4-87ac-0239fb2cf1cf req-a7b70822-d678-4563-a929-4d7994a6a433 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:57.322803 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-1504f8c5-f320-40f4-87ac-0239fb2cf1cf req-a7b70822-d678-4563-a929-4d7994a6a433 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:57.343107 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-1504f8c5-f320-40f4-87ac-0239fb2cf1cf req-a7b70822-d678-4563-a929-4d7994a6a433 service nova] Creating event network-vif-unplugged:339825d0-35e4-4eaf-b676-07b400132d16 for instance f0469523-c4e6-4c17-8065-db8feebb991f on hv-cinder-76330 Jan 15 02:54:57.348844 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-1504f8c5-f320-40f4-87ac-0239fb2cf1cf req-a7b70822-d678-4563-a929-4d7994a6a433 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054120 Jan 15 02:54:57.350388 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 529/1028] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:54:57 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:54:57.591848 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-d815493c-7080-4621-8ff0-8486a34853d2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:54:57.592509 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-d815493c-7080-4621-8ff0-8486a34853d2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:54:57.600875 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d815493c-7080-4621-8ff0-8486a34853d2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:57.601403 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d815493c-7080-4621-8ff0-8486a34853d2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:57.602234 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d815493c-7080-4621-8ff0-8486a34853d2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:57.602719 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-d815493c-7080-4621-8ff0-8486a34853d2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:57.850857 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-d815493c-7080-4621-8ff0-8486a34853d2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:54:57.859797 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-d815493c-7080-4621-8ff0-8486a34853d2 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f" status: 200 len: 1465 microversion: 2.1 time: 0.277684 Jan 15 02:54:57.860395 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 500/1029] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:54:57 2021] GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f => generated 1465 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:54:58.641852 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [req-e666c32a-d4a0-470b-a6c0-023df54ca69a req-0e3970c0-d970-4496-9239-da716bd3c386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0469523-c4e6-4c17-8065-db8feebb991f", "name": "network-vif-deleted", "tag": "339825d0-35e4-4eaf-b676-07b400132d16"}]} {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Jan 15 02:54:58.650962 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 02:54:58.650962 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: warnings.warn(msg) Jan 15 02:54:58.661304 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-e666c32a-d4a0-470b-a6c0-023df54ca69a req-0e3970c0-d970-4496-9239-da716bd3c386 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:58.662506 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [req-e666c32a-d4a0-470b-a6c0-023df54ca69a req-0e3970c0-d970-4496-9239-da716bd3c386 service nova] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:58.681593 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.compute.server_external_events [req-e666c32a-d4a0-470b-a6c0-023df54ca69a req-0e3970c0-d970-4496-9239-da716bd3c386 service nova] Creating event network-vif-deleted:339825d0-35e4-4eaf-b676-07b400132d16 for instance f0469523-c4e6-4c17-8065-db8feebb991f on hv-cinder-76330 Jan 15 02:54:58.686791 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [req-e666c32a-d4a0-470b-a6c0-023df54ca69a req-0e3970c0-d970-4496-9239-da716bd3c386 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062865 Jan 15 02:54:58.687440 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 530/1030] 10.222.0.37 () {64 vars in 1308 bytes} [Fri Jan 15 02:54:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 02:54:58.884331 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b239e11c-98f7-42c2-9f73-c26624b3dea4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:54:58.884963 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-b239e11c-98f7-42c2-9f73-c26624b3dea4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:54:58.892739 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b239e11c-98f7-42c2-9f73-c26624b3dea4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:58.893275 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b239e11c-98f7-42c2-9f73-c26624b3dea4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:58.894101 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b239e11c-98f7-42c2-9f73-c26624b3dea4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:54:58.894588 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-b239e11c-98f7-42c2-9f73-c26624b3dea4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:54:59.031393 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.policy [None req-b239e11c-98f7-42c2-9f73-c26624b3dea4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4528fe6b5a429688aeb5edbbf328e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a605fa30d830427db71d8178d5db456e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94112) authorize /opt/stack/nova/nova/policy.py:225}} Jan 15 02:54:59.041772 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b239e11c-98f7-42c2-9f73-c26624b3dea4 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f" status: 200 len: 1224 microversion: 2.1 time: 0.166707 Jan 15 02:54:59.042423 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 501/1031] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:54:58 2021] GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f => generated 1224 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 02:55:00.065871 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-872baa10-9bad-4332-a065-21063e3f0cff tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:55:00.066655 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-872baa10-9bad-4332-a065-21063e3f0cff tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: f0469523-c4e6-4c17-8065-db8feebb991f] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:55:00.075176 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-872baa10-9bad-4332-a065-21063e3f0cff tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:55:00.075696 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-872baa10-9bad-4332-a065-21063e3f0cff tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:55:00.076560 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-872baa10-9bad-4332-a065-21063e3f0cff tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:55:00.077086 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-872baa10-9bad-4332-a065-21063e3f0cff tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:55:00.134459 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-872baa10-9bad-4332-a065-21063e3f0cff tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] HTTP exception thrown: Instance f0469523-c4e6-4c17-8065-db8feebb991f could not be found. Jan 15 02:55:00.135056 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-872baa10-9bad-4332-a065-21063e3f0cff tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Returning 404 to user: Instance f0469523-c4e6-4c17-8065-db8feebb991f could not be found. {{(pid=94111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:55:00.135958 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-872baa10-9bad-4332-a065-21063e3f0cff tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f" status: 404 len: 111 microversion: 2.1 time: 0.079921 Jan 15 02:55:00.136565 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 531/1032] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:55:00 2021] GET /compute/v2.1/servers/f0469523-c4e6-4c17-8065-db8feebb991f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:55:00.150739 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-b3d30830-f4a8-45c9-a64c-79b8093a3c90 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '.version_select at 0x7f878e625598>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:55:01.519302 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-b3d30830-f4a8-45c9-a64c-79b8093a3c90 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "DELETE /compute/v2.1/os-floating-ips/6ea066f6-8745-483f-8e72-2d1869955079" status: 202 len: 0 microversion: 2.1 time: 1.377823 Jan 15 02:55:01.519979 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 502/1033] 10.222.0.37 () {58 vars in 1253 bytes} [Fri Jan 15 02:55:00 2021] DELETE /compute/v2.1/os-floating-ips/6ea066f6-8745-483f-8e72-2d1869955079 => generated 0 bytes in 1379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:55:01.534261 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-0067f7e8-a0f4-43ca-b752-6d1ee2b54aed tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:55:01.534811 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-0067f7e8-a0f4-43ca-b752-6d1ee2b54aed tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94111) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:55:01.543525 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0067f7e8-a0f4-43ca-b752-6d1ee2b54aed tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:55:01.544030 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0067f7e8-a0f4-43ca-b752-6d1ee2b54aed tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:55:01.544863 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0067f7e8-a0f4-43ca-b752-6d1ee2b54aed tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:55:01.545383 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-0067f7e8-a0f4-43ca-b752-6d1ee2b54aed tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:55:01.598148 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-0067f7e8-a0f4-43ca-b752-6d1ee2b54aed tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] HTTP exception thrown: Instance 883232af-b44d-4667-a346-099139fb27ea could not be found. Jan 15 02:55:01.598818 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-0067f7e8-a0f4-43ca-b752-6d1ee2b54aed tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Returning 404 to user: Instance 883232af-b44d-4667-a346-099139fb27ea could not be found. {{(pid=94111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:55:01.600264 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-0067f7e8-a0f4-43ca-b752-6d1ee2b54aed tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "DELETE /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 404 len: 111 microversion: 2.1 time: 0.075497 Jan 15 02:55:01.600861 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 532/1034] 10.222.0.37 () {58 vars in 1229 bytes} [Fri Jan 15 02:55:01 2021] DELETE /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:55:01.615948 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-73db96c3-4262-4e8e-af9b-f3906a5127aa tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:55:01.616627 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.compute.api [None req-73db96c3-4262-4e8e-af9b-f3906a5127aa tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] [instance: 883232af-b44d-4667-a346-099139fb27ea] Fetching instance by UUID {{(pid=94112) get /opt/stack/nova/nova/compute/api.py:2787}} Jan 15 02:55:01.625222 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-73db96c3-4262-4e8e-af9b-f3906a5127aa tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:55:01.625772 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-73db96c3-4262-4e8e-af9b-f3906a5127aa tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:55:01.626572 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-73db96c3-4262-4e8e-af9b-f3906a5127aa tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Jan 15 02:55:01.627067 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG oslo_concurrency.lockutils [None req-73db96c3-4262-4e8e-af9b-f3906a5127aa tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Lock "970f11a0-4ab6-42a9-9f4d-116f76c8b008" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Jan 15 02:55:01.682516 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.wsgi [None req-73db96c3-4262-4e8e-af9b-f3906a5127aa tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] HTTP exception thrown: Instance 883232af-b44d-4667-a346-099139fb27ea could not be found. Jan 15 02:55:01.683187 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-73db96c3-4262-4e8e-af9b-f3906a5127aa tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Returning 404 to user: Instance 883232af-b44d-4667-a346-099139fb27ea could not be found. {{(pid=94112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Jan 15 02:55:01.684090 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-73db96c3-4262-4e8e-af9b-f3906a5127aa tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea" status: 404 len: 111 microversion: 2.1 time: 0.078569 Jan 15 02:55:01.684713 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 503/1035] 10.222.0.37 () {58 vars in 1226 bytes} [Fri Jan 15 02:55:01 2021] GET /compute/v2.1/servers/883232af-b44d-4667-a346-099139fb27ea => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 02:55:03.061493 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-128de1c8-2e57-478a-aaae-d450ea0390c1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '.version_select at 0x7f878e5557b8>' {{(pid=94111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:55:03.324870 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-128de1c8-2e57-478a-aaae-d450ea0390c1 tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "DELETE /compute/v2.1/os-security-groups/54edb4da-64e3-4a65-bef0-f963cdcf65f0" status: 202 len: 0 microversion: 2.1 time: 0.273296 Jan 15 02:55:03.325793 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94111|app: 0|req: 533/1036] 10.222.0.37 () {58 vars in 1262 bytes} [Fri Jan 15 02:55:03 2021] DELETE /compute/v2.1/os-security-groups/54edb4da-64e3-4a65-bef0-f963cdcf65f0 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:55:03.342320 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: DEBUG nova.api.openstack.wsgi [None req-a0226994-e8ea-45ac-8c63-429375d5edce tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] Calling method '.version_select at 0x7f878e742b70>' {{(pid=94112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 02:55:03.367802 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO nova.api.openstack.requestlog [None req-a0226994-e8ea-45ac-8c63-429375d5edce tempest-TestVolumeBootPattern-361710776 tempest-TestVolumeBootPattern-361710776] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-875881786" status: 202 len: 0 microversion: 2.1 time: 0.037390 Jan 15 02:55:03.368440 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: [pid: 94112|app: 0|req: 504/1037] 10.222.0.37 () {58 vars in 1250 bytes} [Fri Jan 15 02:55:03 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-875881786 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 02:55:49.639431 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 02:55:49.639984 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: Fri Jan 15 02:55:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 02:56:21.659923 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 02:56:21.660431 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: Fri Jan 15 02:56:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 02:57:37.276644 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 02:57:37.277433 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: Fri Jan 15 02:57:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 02:57:44.785628 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 02:57:44.786234 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: Fri Jan 15 02:57:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 02:58:04.505716 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 02:58:04.506318 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: Fri Jan 15 02:58:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 02:58:10.404102 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 02:58:10.404664 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: Fri Jan 15 02:58:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 02:59:09.658903 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 02:59:09.659498 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: Fri Jan 15 02:59:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 02:59:41.678346 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 02:59:41.678836 dv-cinder-763306-8-iscsi devstack@n-api.service[94109]: Fri Jan 15 02:59:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!